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Abstract 
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1. Introduction 



In 1982, Drew McDermott [38] wrote, 

A common disclaimer by an AI [Artificial Intelligence] author ia that 
he has neglected temporal considerations to avoid complication. The 
implication is nearly made that adding a temporal dimension to the 
research (on engineering, medical diagnosis etc.) would be a familiar, 
but tedious exercise that would obscure the new material presented by 
the author. Actually, of course, no one has ever dealt with time correctly 
in an AI program, and there is reason to believe that doing it would 
change everything. 

There are many reasons why this should be. Phenomena that we associate with 
time's passage, such as change, are ubiquitous. This is reflected in our view of the 
world, and the language and notation we use to describe it. It should therefore not 
be surprising if expert systems, bereft of a conceptual representation and vocabulary 
of time, as well as the necessary mech a nism s to make temporal inferences, fail in 
general to interact smoothly with us. Expert system performance and knowledge 
acquisition is at best incomplete and at worst fatally flawed if the system does 
not possess a systematic and principled "understanding- of temporal knowledge. 
Therefore, even though temporal reasoning is not in and of itself sufficient to produce 
satisfactory behavior in expert systems, it is a necessary and significant step in that 
direction. 

In contrast to the state of affairs in the late 1070's, described by McDermott, 
in the past six years several projects have addressed the problem of incorporating 
temporal reasoning in AI programs. The emphases of these projects vary with the 
application domain. Some areas of knowledge sesm to be more dependent upon and 
demaiidingoftemiKwallaiowtodg^ The initial "blocks world- experi- 

ments [65] were adequately served by a simple ordering of events. Other applica- 
tions require considerably more sophistication. Medkal diagnosis and therapy are 
often selected as test tasks, not so much because they provide realistic tests of the 
breadth of representation and the generality of the temporal reasoning mechanism, 
but because without such capabilities, perfmanee m these domains is poor. 

Within the domain of medical expert systems, the efforts in temporal reasoning 
have tended to focus on issues most relevant to intensive care. That is, domains 
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in whfch th«. are large amount, of real-time data avaikbk, and where the value, 
of aeverad physiological variable, are known and can change rapidly and often. In 
.uch application, the emphask is on abrtracting point daU, costing erroneou. 

^°^r; ma * ni pMdktioa « "*~* «»t«re value. ba*d «« perceived trend. 
[16,32,33J. In contra*, the temporal issue, involving the taak of patient hurtory- 
dnven diagnosi., have only been cursorily examined. Thk task is the focus of thi. 
thesis. In the sections that follow, I jurtify thi. choke and briefly outline the .pecific 
temporal issues involved. 



1.1 The Patient History 

Apart from serving a. an investigational tool to .tudy the ksues of temporal rea- 
soning, patient hktory-driven diagnosis is a worthwhile task fc tenns of the broader 
objective, of AIM [Artificial Intelligence in l^ki^. The ,m^ Wrtory romsina 
the most powerful and widely used diagnostic tool of health-care practitioners. It 
serve, to narrow the diagnostk possibilities so that other, much more exp«isive, di- 
agnostic modalitk. can be employed sparingly. Often, the patient history is the only 
available means for establkhing the diagnori..* Consequently, * significant ^t 
of educational resource, k .pent to augment and refine the clinician', ability to 
obtain and use the patient hktory. Capturing and automating .uch widely applied 
expertise, will therefore provide health-care providers with an intellectual tool with 
which to manage many of the problems of the medkal -iaferaiatk* explosion.' 

Increasingly, clinkal practkes-especiaUy large hospitals^are attempting to 
bring patient record., including the patknt hktory, cm-line {2,4,62]. The availability 
of such data holds the promise that expert .yrteins, naming m the 'Wkground-, 
will be »abk to use the patknt histories to perform diagnostic tasfa without requiring 
special attention or effort from health personnel. To be abk to effectively use .uch 
a patient history, it is necessary that the expert system be capabk of sophktkated 
temporal reasoning as k illustrated below. 



fr°mjy*«K h,p» wyt*«n.t«w, th. p*t„ of di^. tk. ptkat ^ort. mifkt b. *• «Uy 
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1.1.1 Time and the Patient History 

Any pathophysiological proem is a creature of many dimensions, one of which is 
time. The patient history is a window onto this creature. If this window filters out 
temporal information, then errors will be made in describing the process and dis- 
tinguishing it from others. Moreover, it is often inadequate to substitute ordering, 
whether partial or complete, for quantitative specification of temporal distance, as 
this quantification may be essential to characterise the process. In order to provide 
a flavor of the different forms of temporal expression in a patient history, a tran- 
script of a fictitious patient visit is presented in the next section. Following this, I 
discuss the role of temporal reasoning in the taking of the patient history. 

Scenario 

The patient, a young male (J.), his mother (Mrs. W.) and the physician (Dr. C.) 
are m the physician'* office. The mother reports concern with fussincss, rapid, 
breathing, cough, and loss of appetite". After the preliminary discussion: 

• Dr. C: "How old is J.?" 

• Mrs. W.: "Two years old." 

• Dr. C: "When did he first become •fussy'?" 

• Mrs. W.: "This past Sunday, when he woke up, around 8 a.m." 

• Dr. C: "Was he coughing that morning?" 

• Mrs. W.: "No, that started later, seven to eight hours later. In the early 
afternoon." 

• Dr. C: "When did you first notice that J. was breathing rapidly?" 

• Mrs. W.: "In the morning, two days later." 

• Dr. C: "When did J. stop eating, or stop eating as much as he usually 
does?" * 

• Mrs. W.: "Monday." 

• Dr. C: "A day before you noticed his rapid breathing?" 
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• Mrs. W.: "No, during the same day he started to breathe rapidly... Tuesday, 
I suppose." 

• Dr. C: "Anybody in the family have a cold?" 

• Mm. W.: "Everyone did, J.'s younger sister too — but she had bronchioli- 
tis." 

• Dr. C: "Is the rest of the family well now?" 

• Mrs. W.: "Yes, my husband was last to get it. He's felt fine for over a 
month." 

• Dr. C: "Has J. ever had anything like this before?" 

• Mrs. W.: "Yes, now that you mention it, it happened about the same time 
last year. The doctor at the time said it could be bronchiolitis or asthma. 
But it cleared up after J. had spent one night in the hospital." 

• Dr. C: "Anybody in the family have asthma?" 

• Mrs. W.: "Yes, both my husband and my brother-in-law had asthma when 
they were children, but neither have had any attacks since." 

Upon further work-up, the physician strongly suspects that asthma is the correct di- 
agnosis. The patient's response to therapy supports this suspicion. The patient and 
his mother are seen one month later for follow-up. During this visit, the following 
conversation arises. 

• Mrs. W.: "Is J. going to keep having these attacks?" 

• Dr. C: "A child like J., diagnosed as having asthma, may follow several 
clinical courses. Some young people with asthma will continue to have attacks 
during their childhood. Of those, a minority have asthma in their adult years. 
Most probably, your son will be symptom-free by the end of his adolescence— 
as was the case for your husband and brother-in-law. Meanwhile, we can 
manage this problem without restricting J.*s activities.* 

There are many temporal concepts in each of the above queries and assertions. 
Among these: 
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• References to common temporal yardstick, such as the calendar, stages of 
development (e.g. in infancy, childhood and adolescence) or numerical age. 

• Relative positions of events, both quantitative (e.g. coughing "seven to eight 
hours" after beginning to behave "fussily .") and qualitative (e.g. anorexia 
"during" the period of tachypnea). 

• Temporal specification with respect to the present (e.g. "He's felt fine for over 
a month." which is an implicit specification of the period immediately prior 
to the present.) 



• Alternate temporal hypotheses. In the above example, the duration of the 
period in which the asthma would be symptomatic depended on the clinical 
course the patient followed (i.e. whether the disease would resolve with the 
onset of adulthood). 

Expert System Performance 

The import of temporal representation is not restricted to the range of expression 
of an expert system and the "human-like" quality of the man-machine dialogue. It 
also makes the performance of the expert system considerably more efficient and 
focused. To illustrate this, take the three findings of jaundice, abdominal pain, 
and blood transfusion. Imagine that these are three (as in figure 1.1(a)) of very 
many findings in the patient history in an automated medical record. A temporally 
naive expert system would have to include the hypothesis of transfusion-borne acute 
hepatitisB high in the differential diagnosis. It ought be however, that the temporal 
relationships inthiscaesweresuchthattoa human medical expert, there would 
never be any question, or at the most a low likelihood of this diagnosis. The jaundice 
may have happened during the neonatal period, the abdominal pain could have 
happened after an appendectomy, and the transfusion may have occurred during a 
later caesarian section. 

Now, if we were to replace the previous, temporally naive expert system with 
one capable of causal reasoning, then the expert system would be able to use the 
temporal precedence relations between causal antecedent and consequent to dis- 
tinguish between some hypotheses. If such an expert system were given a patient 
history that included the assertions that a blood transfusion preceded both abdomi- 
nal pain and jaundice (as in figure 1.1(b)), then the hypothesis of transfusion-borne 
acute hepatitis B would again rank high in the differential diagnosis. However, if 
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a physician had been told that the transfusion had preceded the jaundice by only 
one day, a lot of other cause, for the jaundke would come to mind, becau* the 
mcubation period of the hepatitis B virus is considerable longer than one day. 

Were we to go one step further, to enable the previous expert system to reprewnt 
and reason with quantitative temporal information, this would still be inadequate. 
For instance, if such an expert system were given a patient hktory that included the 
assertions that the jaundke had followed the blood tranrfueion by two months, and 
the abdominal pain had followed the tranrfuskm by 45 days (a. in figure 1.1(c)), 
then yet again the program would rank acute traarfuskm-borne acute hepatitis high 
m the differential diagnosis, ff however, the jaundice had occurred 20 years ago^ 
then for the human expert, the diagnosis would not be a leading element of the 
current differential diagnosis. ^^ 

The point made by th«M example, is that the ability to use a large variety 
of temporal information permit, a dramatic pruning of the problem space-the 
number of hypothecs to be conridered. Thi. i. important both l^cau^ it lighten. 
the computational burden of the expert syrtem, and afao becawe it cut. down 
requests for patient information and teat, that might involve extra financial costs 
and unnece«ary patient morbidity. Thi. pruning of the problem .pace al«> has 
the secondary effect of producing a more focused and human-like diagnostic style, 
as many obviously unreMonabl. hypothec, are elmcet immediately excluded from 
serious consideration. 

1.1.2 Organization of the Diagnostic Ta»k 

The example, above Ulurtrate son* of the different genre, of temporal expression 
that can be found in a patient hktary. To dkcue. the veriou. role, of temporal 
reasoning in patient hktory-driven dUgncek, I have arbitrarily, divided thi. ta.k 
into five distinct phaw.. A. de^bed briow, th« pha«. may ^^ to follow e^h 
other in linear sequence, but a. diagrammed in figure 1.2, there may be multiple, 
cyclic path, through these phases. 

Initial Data Gathering 

The first phase of the diagnoetk task is that of data-collection, or history-taking. 
The activity in this phase i. largely driven by the data collected, rather than by any 
hypothesis of the patient's pathophyriological status. Thi. i, to be oktingukhed 
from the later phaw. of the diagnostk tesk, after the evocation of hypothec, 
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Figure 1.1: Misdiagnoses of Hepatitis B 
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Figure 1.2: Phases in the Taking of a Patient History. 
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when the line of questioning is directed by the content of the actively considered 
hypotheses.' The "compiled" data-driven protocol ia an evolutionary product of 

J°^, uf^ eXp * rieac « whkh "«-*• tho« questions that are always 
worthwhile a*ing in r-po^e to a particular clinical prestation. For instance, 
a ^tombh! cheat pain, will taually be asked about it- location, radiation, 
and quality. The temporal data will include the duration of the pain, time of day 
of onset, temporal relation to precipitatinf eventa, and if recurrent, the length of 
time between episodes. 

In general, to avoid being misled by erroneous data, the data-gathering phase, 
taking place as it doe. before much investment of diagnostic effort, is an opportune 
occaaion to detect errors. Temporal reasoning can serve in this effort by identifying 

T*T °Z rf incoMirt « lc y- F <* ««»Pfe> m our earlier tran^ript of the 

fictitteu^offlce vi.it, Mrs. W.'s statement that J. was tachypnea two day. after he 
was -fussy* (Sunday) contradicts the amotion that the onset of J.'s anorexia waa 
on Monday and yet occurred at the aame time as the onset of tachypnea (Tuesday). 

Evocation 

Following hiatory-teking, the next dkgnoatfc ph.* u that of hypothesis evocation 
or triggering. From the rather large problem-space of diagnoatk categories, an 
•xpert^rstem (and for that matter, a human expert) murt .elect a manageably 
small number of hypothecs.' This can be achieved by .electing cla*es of hypothe- 
ses based on characteriatic constellation, of finding, in the patient history. For 
instance, if a patiant describes sweating, and a sensation like a ton of bricks on my 
chest, this should immediately trigger (bring into consideration) the hypothesis of 
myocardial infarction (MI). The* constellations of finding, include characteristic 
temporal patterns. Chest pain lasting not more than one or two seconds or more 
than one or two hours ia consistent with several diagnoatk possibilities, including 
cervical osteoarthritis, but is atypical for angina. 



8 S~ N«rtUaitd Simon [42] for a dUcn-ion of th. UmiU tf cot*tt»aaiHieom,mtatkmalr«o»rce 
akin ut managing nmHipb aypot&Mat. 
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Elaboration 

Once a hypothec is triggered, the next phaee of diagnosis begins, that of elabo- 
ration. Each triggered hypothesis usually consists of a broad category of distinct 
diseases, usually with some pathophysiological pathways in common. Each distinct 
pathophysiological pathway within the triggered hypothesis is a hypothesis onto 
itself. The latter hypothesis will be referred to as a seMspeMeMs. The process of 
extracting the different subhypotheses within the triggered hypothesis is the process 
of elaboration. 

As each subhypothesis represents an alternate clinical course, it is usually the 
esse that each of the subhypetheses has different temporal constraints. A patient 
with angina pectoris, for instance, may subsequently suffer a sudden MI, or first 
have congestive heart failure (CHF) before the MI, or immediately suffer a fatal 
arrhythmia. The duration of the interval from onset of angina to a locally stable 
state (death or recovery) therefore depends on which clinical course is followed. To 
return to the office visit example, the duration of J.'s asthma wfll depend on the 
subpopulatkm of asthmatics to which he belongs. 



Instantiation 

Each of the subhypotheses extracted from the triggered hypothesis is a template 
for a possible clinical course. To model a particular patient, the date obtained 
from the patient must be fitted in some way to the subhypotheses, to provide a 
coherent support for the described condition of the patient. The process of con- 
structing a patient model, matching findings to evenm m the subhypothesis, is that 
of instantiation, the fourth of the five phases of patient history based diagnosis. 

Patient-specific date further constrains the temporal relations in the subhy- 
potheses, and also anchors the subhypotheses to the present. In J.'s visit to Dr. 
C.'s office, the patient date specifies that the "current* visit occurred after these 
findings of anorexia and tachypnea were noted, and sejbre therapy was instituted. 
This specification anchors the subhypothesis with respect to the present. This may 
seem obvious, and yet it prevents unreasonable diagnostic behavior such as seeking 
therapeutic effect before therapeutic intervention or asking whether J. suffers of 
asthma as ah adult. 
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Ranking Patient Models 

After the creation of several patient model., it becomes possible to proceed to the 
next diagnostic phase, that of selecting the correct diagnosis or at least ranking 
these model, with respect to their likelihood. Many diagnostic strategies can be 
brought to bear in this plus, to facilitate ranking or confirming a patient model. 
The goal that these strategies have in common is to determine which datum would 
be most effective in narrowing the number of diagnostic possibilities or further 
differentiating the more likely from the less likely. 

Temporal information often costs little to acquire and can also serve the vari- 
ous diagnostic strategies* to distingukh between patient models. In distingukhing 
between an acute and a recent MI, it would be useful to obtain aerial SCOT mea- 
surements to determine whether the SOOT peak was approaching (the SCOT peak 
occurs within 24-48 hour, of an MI) or part. In the same vein, during J.', vi.it to 
Dr. C. • office, a history of recurrence, especially in association with a particular 
season, would support the diagnosis of asthma rather than bronchiolitis. Otherwise 
m the acute phase, without these temporal clues, these two clinical entities are often' 
indistinguishable. 

1.2 Technical Goals 

What then must be required of a temporal representation and reasoner to enable 
the emulation of the breadth of expression and the behavior described above? 

1.2.1 Breadth of Representation 

Several efforts in temporal reasoning have made use of heterogeneous internal rep- 
resentations [26,41] to represent the heterogeneity of temporal expression found in 
the patient history. One of the shortcomings of these representations is the dif- 
ficulty in determining the order and combination in which the different temporal 
representations are to be used to retrieve temporal information. The difficulty lies 
in deciding which combination will be the most efficient, ensuring that the temporal 
information retrieved is consistent with the rest of the temporal data base and as 

4 Tfc* cssenl form of th«M rtntagi* (.., . COKFXUt. I0LB-0UT, ud DOTBEMTIAH) ku b«B 
dMcribed by P«U1 [4S] **d Popk [50). ■"■Tiaiaj ft- b-n 
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precise as possible. Making this decision becomes far easier if all temporal asser- 
tions are maintained within a single representation and manipulated by a single, 
simple inference mechanism. Consequently, one of the earliest objectives of this 
research was the development of a uniform underlying representation to see if it 
could support the necessary breadth of expression. 

1.2.2 Computational Feasibility 

The computational burden of temporal "reasoning- increases rapidly with the num- 
ber of events represented in the temporal data base. Several schemes have been 
developed to work around this problem. Most of the approaches have involved vari- 
ations on the "divide and conquer- theme. In such cases, the temporal data base 
is clustered according to a particular scheme, into blocks— usually of contiguous 
intervals. Temporal reasoning is then restricted locally to each block. Allen's [1] 
clustering scheme generates hierarchies of intervals where each interval is DURIMG the 
interval that is immediately superior to it in the hierarchy. Vere's [58] hierarchies 
consist of events associated with activities of a planner. The temporal hierarchy 
built from the planner's activities mirrors the goal-eubgoal hierarchy of the planner. 
In both systems, retrieval of temporal information relating events in different blocks 
involves some form of search. 

Each clustering scheme must be judged by several criteria. First, to what extent 
do the various application domains fall naturally into the imposed hierarchy? Sec- 
ond, to what degree does the clustering scheme lead to retrieval of inconsistent and 
imprecise temporal relations? Finally, can the clusters be generated automatically? 
For pragmatic reasons, a lot of the work on TUP was done to answer the preceding 
questions. 

1.2.3 Interaction of Temporal and Atemporal Reasoning: 
Domain Independence 

It was not at all obvious, at the onset of this project, that temporal data and 
inferences could be neatly separated from the other conceptual elements of an expert 
system. Causality, for instance, would appear to intrinsically impose some degree of 
temporal ordering on events. It was therefore unclear whether temporal reasoning 
could be isolated and packaged separately or would necessarily have to be tightly 
coupled with other reasoning mechanisms of a host expert system. If temporal 



t* f»- *. 



1.3. RESULTS 

13 

re^afag could notbe bolated in an autonomous package with a standard interface, 
it would be unlikely that a general aolution could be attained to satisfy various 
expert syrfeme whoee repweentation of caueaHty wu as mU ch at variance as say 
qualitative simulation [29,13,17] and causal a-odation [51,50,46,31]. Achieving a 
domain and ^tern-independent .olution therefor* became a major focus of this 



1.3 Results 

Which of the preceding objective, hare been achieved? First, the various forms 
u«d to specify temporal poritkm within a patient history (heretofore called Umpo- 

JTT ? ^ ^ "***- A «»*«* repmentation, b«ed on the range 
relafon ha. been developed, capable of repmeatiag the t«nporal deacriptor. nee- 
~xy for producing a patient hkrtory. Then, include quantitative and qualitative 
relation, between any arbitrary combination of point, and intervale, references to 
common temporal yardntkk., reference, to the pteeent, pewfafne. and alternate 
temporal hypothec. A Tempom/ UtXty ***,, (TUP) ha. been conrfructed that 
™*«"« — «tten. of aU the patient hktory t««^oral d-criptor. and translate, 
them into range ration form. TUP than perform. aU the required temporal rea- 
soning and coudrfency checking, u.ing a form of constraint propagation. TUP also 
pouene. a number of temporal retrieval function, and temporal predicate. 

TUP feature, a .tandard interface that permit, the heet syrtem to dictate the de- 
B ^ C J™*™^** ***** dafba-fer tnere.**. of computational fea.ibility 
mentioned previously. During TUP'. development, it became clear that although 
TUP permits lany clustering scheme to be hM«n«»ed, only the few that conform 
to a particular ^ of raquirement. (diecueaed at length in the following chapter) 
will be succeerful in yielding the dorired reduction in computational load. One of 
theee requirement, is that event- within the »«ne clurter be more clceely* related 
1 1!^ otiwrtllWl *° "«*• m <*** <*«*•». Several expert .yrtem technologies, 
by theirneture, provide an organbing principle with which temporai clustering can 
be guided. In this report, an implemented expert »y*em is deecribed that uses 
it. cauaal aggregation hierarchy (similar to thoee found in other wcond generation 
expert syrteme such •* ABEL [46}) to control the automatic generation of temporal 
cluster.. Planner., frame-baaed system., and qualitative simulator* also possess 

•Again, diacwrio. of th. «*ct nwaaia, of tab k deond to tlu n«t diapt« (action 2.4). 
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structures that can be employed to automatically guide temporal clustering. These 
latter instance, are discuwed in this report but have not been implemented. Abo, a 
number of intriguing cognitive analogies to the temporal clustering scheme, appear 
in the literature. Thero are discussed in chapter 5. 

Reasoning about alternate hypothec., medical or otherwi«, involve, examining 
different outcome.. Each of the* outcom— in medicine, the pathophy,iological 
history-ha. attociated event duration, that uwally vary with each hypotheei.. TUP 
provide, a context mechanic that p«mit. the alignment of temporal awertiou. 
p '^l* ^Z*? 1 ***"—> THRIPHT [Tempond Hypotkuis Reasoning In 
Pattent Hrtory-Tahng) the medical expert .yt«n u«d a. an invtigative vehicle, 
automatically create, context, for each patient model generated. 

1.3.1 Expert System Demonstration 

THRIPHT wa. con.tructed both to demonstrate TUP', capability and to provide a 
vehicle for inverfigating the propertie. of the dingncatk proce« when the patient 
model, are equipped with a syrtematic reputation of temporal relationships. 
What THRIPHT really do- i. beat described by burning toTflv. pha*. ofTe 
diagnostic task, outlined in -ction 1.1.2. It i. in the couwe of the data-gathering 
Phase, that patfcnf. a—rtkm. are procewed by TUP and converted into range 
relation form. By virtue of the conrtraint propagation proc. that follow, each 
temporal *««rtion, temporal incowktmicie. or contradiction, are identified imme- 
diately, and the uwr/patient given the option of which section to withdraw. 

Hypothec, are evoked in the following pha» by mean, of -trigger." linked to 
hypothec template.. Each trigger te.t. the patient action, accumulated in the 
data-gathering pheae. Naturally, the trigger, can tert for temporal relation, that are 
deduced from the awertion., even if not explicitly aMerted. The triggers themwlve. 
are arbitrary boolean combination, of temporal and atemporal predicate*. 

Each hypothe*. template i. reprewnted a. a directed, acyclic graph of event 
node, linked by a-ociational or catual link.. Within each mch template, exclu.ion 
relations .pecify which event, are mutually exchuuve. The,, excluwon relation, 
are used m the hypothec elaboration proem, to generate dktinct and mutually 
exclusive .ubhypothcM.. 

Temporal information i. aMociated with each event in the hypotheei. template. 
Thu, information include, specification of the temporal antecedence of causally an- 
tecedent event., event durations and other a priori temporal knowledge. On elab- 
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oration, the temporal information ia carried forward to each .ubhypothesi. and a 

generation of temporal context., that the temporal data i. cluetered. THRiPHT 
communKate. to TUP the causal aggregation information that TUP then^ for 
defining the temporal clueten. 

^l^^^T^ "H??* » bound to each .ubhypothesi.. This 

^£r*£*? temPW * 1 WUa ° M » ***** m *"» ^^ W«tory-taking, to 
modify the default aeeumptione of the eubhypotheee.. 

A. outlined previou.ly, the primary goal of the diagncetic .trategie. of the fifth 

relltTtot M^ thm *~ ~ "^ "* to * «** p£* <^ 
related to the diffenng expectation, of the r«pective patient model.. Timing, of 

course » one «ch feature and therefor, in addition to dirtingukhing patilntmod- 

difference, in temporal dktanee. between event.. TW. diagnortk .trategy loop 

i" JT^ ^ PifUaI|f Uapkm ~ ted ' Principally became of the effort required*, 
elaborate .uch .trategie., even without temporally .ophkticated capabilities. 

1.4 Organization 

TUP f< SZ lni ^ P f d '^ lb " "" "»~-"«« -* "-o^ing mechankm of 
TUP. Comparkon. to pnnriou. work in this «» ,«, made a. the kra. arke. I 

£^j££ » ■—! term., how TUP would mteract with variou. expert system 

™ temporally explkit patknt record, and how the* interact with 

In addition to the benefit, of added expreauve power and generality of reasoning 

engineer. In chapter 4, the chalknge of extracting temporal knowledge from the 
literature and delivering it to an expert syUm k examined. 

There have been -vera! rtudk., in the dkcipiine of cognitive science, of tern- 
poral reawmng. It become, tempting, becauee of .imilariti- that appear, to draw 
analog*, between the experimental recite of cognitive cience and the behavior 
of TUP. However, the remit, are not without controvert, even within the ranks 
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aritav *■ re,OTMce - — — — * *— »*-«* 

Chapter 6 recapitulates the results of the work Am*. «f ~ i~ 
coat™, a itt „ t-ZSZZZSZt XST iTf O 

provd. ^ud «*_ * «,. ***„», j£ sees Appm,i " ° 



2. The Temporal Utility Package 

The Temporal Utility Package (tup) is designed to perform domain and system- 
independent temporal reasoning. TUP's internal representation and reasoning mech- 
anisms are described in this chapter. 

2.1 The Range Relation 

The range relation (or RREL in TUPese) is a first-order object in TUP's representa- 
tion. It is from this object that all the other type, of temporal representation are 
built. Range relations specify the upper and lower bounds on the temporal distance 
between two points in time. The range relation is specified in TUP's syntax using 
the form below: 

Form 1 

(RREL <f irst point > <second point> 
<lower bound> <upper bound> 
<context>) 

Individual points are identified in this form by list, of qualifier-value pairs The 
qualifiers can specify whether the point represents a point event or the beginning or 
end of an interval. Qualifiers may abo specify that a point is a member of a cluster 
(see section 2.4) or is a point along a particular temporal yardstick (see section 2.6). 

Bounds on the range relation can have all values from positive to negative infin- 
ity. Numerical values can be in any time unit from seconds, minutes, to centuries, 
even though all these values are canonicaUy stored in seconds. The value of the 
lower bound must however never exceed that of the upper bound. ffTUPmakesa 
temporal deduction that violates this rule (see section 2.2.4), it is always taken to 
mean that there are inconsistent or contradictory temporal assertions. 

As mentioned in the introduction, contexts permit the representation of alter- 
nate temporal assertions. The context specified in the RREL aasertion of form 1 can 
be any object-atomic symbol or hypothesis. If not specified in an assertion, it 
defaults to REALITY. 

17 
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2.1.1 Diagrams and Descriptions 

Some explanation is required for the diagrams and English "translations" that ac- 
company the temporal assertions in the examples that follow. The diagrams will ini- 
tially only serve to illustrate the graphic format used to describe the RREL. However, 
as the assertions increase in number and more complex features are demonstrated 
these diagrams will become the primary vehicle for analysing the consequences of 
the assertions. The mapping from RREL to English is a delicate matter and is the 
major reason for the graphic illustration of the temporal relationship. The problem 
stems from the richness of meaning of the English language. This richness makes it 
all too easy to attach meaning to temporal assertions other than is present in the 
formal syntax (or diagram). In example 1 (page 19) for instance, I am careful to 
avoid making any allusion to the position of irritability or anorexia with respect to 
the present. 1 Specifying the position with respect to the present would require the 
assertion of at least one more RREL (as described in section 2.1.2). Consequently, the 
English translation provided should be viewed as an aid in comprehending the tem- 
poral relations; the graphic representation however should be examined to obtain 
the strict interpretation. 

Regarding the diagrams themselves, two different graphical representations of 
the temporal relations were considered— time-line and directed graph, both illus- 
trated in Figure 2.1. In timeline diagrams the points are visually ordered with 
respect to a reference point, with a scaled lower and upper bound displayed for 
each point. The directed graph diagrams do not necessarily visually convey infor- 
mation of the temporal order, but rather permit inspection of individual point to 
pomt temporal relations, rime-line diagrams have several weaknesses, at least for 
the purposes of illustrating reasoning with RREL.. As all temporal relations are 
illustrated with respect to a reference point, it is difficult (without additional dia- 
grams that use other reference points) to appreciate temporal relations other than 
those that involve the reference point. This is especially true when the upper and 
lower bounds do not share the same sign. 8 Abo, to understand how TUP makes 
its temporal deductions, it is important to visualise the connectivity between the 
RRELs. This is particularly useful in following how TUP clusters the temporal data 
base. 

For the reasons above, except for example 1, 1 have illustrated temporal relations 



x Aj in "pracaded" or "will precede." 

3 i.e. a point ocean before or after the reference point. 
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exclusively with the directed graph format. However, to the degree it is possible 
I have attempted to visually convey the ordering information using the directed 
graph format, by having earlier points above, or to the left of, later time points. 

2.1.2 Examples 

The description of TUP's reasoning mechanisms will be a lot clearer and better 
motivated if we first look at several RREL examples. 

Example 1 



\* dais; 13 DAYS)) 



Example 1 corresponds to the assertion that the beginning of irritability precedes 
the end of anorexia by two to three days. 

Example 2 



(-3 HOURS) (-1 HOURS)) A " IB, "* W ' 



Example 2 corresponds to: the onset of sleep terrors occurs one to three hours 
after the end of awakeness. 

Example S 



(RREL CfMAljE ASJgU-n (TYPE EHO-MTERVAL)) 

((NAME ASTHMa-2) (TYPE BEOIM-IITERVAL)) 
(-EPSILOM) (♦IHFIMITY)) "™*val;; 



■£%^-,r$r$x T :^. : ';^^a^if^^^^^^>^Bi^.i 
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Figure 2.1: Time-Line and Graph Fonn of Temporal Diagram 
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<SLEEP TERRORS 



D~ 



ihours 



-3 HOURS 



»» AWAKE> 



which is synonymous with: 



| <SLEEPTERRORS W 



3 HOURS 



1 HOURS 



AWAKE> 



J 



Figure 2.2: Illustration of assertion of example 2. 
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ASTHMA- 1> 




•fOO 
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<ASTHMA-2 



) 



Figure 2.3: Illustration of assertion of example 3. 
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This assertion has a lower bound e, a quantity that TUP takes to be smaller 
than any numerical value the computer can repreaent. Temporal reaaoning with 

Z i£7t V7*%* ^ "*" 22 ' 2 ' ThM — *■ rf — ^ 3 correTponds 
to. the attack of asthma epbode number two can occur any time after* asthma 

episode number one. Note that although the upper bound of the RREL is +oo in 
any complete expert system that would u* TUP, this bound would be constrained 
to the maximum life expectancy of the individual. In THRIPHT'. knowledge bases 
many ejent interval, are aaserted to occur during the interval of LIFE. Since LIFE* 
Really the RREL that relate, the beginning and end of the interval) ha. an upper 
bound of longevity gen«rou.ry set at 120 year, and 237 day. [52], most temporal 
relation, of pathophysiological event, become finite after constraint propagation 
(described in section 2.2.2). "^ 



Example 4 



(RREL (CREFSYS CALEHDAR) 

(mrnSt)) 9 P '*" * wd * 7 ' April 27th ' i99 * m) 

Example 4 introduce, the temporal "yardstick'. Although any number of such 
yardstick, can be defined, at the moment TUP only include, definition, of the calen- 
dar, age., developmental stage., and life-landmark.. Within TUP the* yardsticks 
axe implemented a. mini-expert, that know enough about their own referee sy^ 
tern (the temporal yardstick) to be able to aeeert REEL, between pointe belonging 
^i™*."^ ly****-**""*™ of detail, k deferred until section 2.6. 
The CALEMDAR reference eyitem recognae. all form, that evaluate to point, on the 
date-line wherea. DEVELOPMEIT accept, all <tefined .tege. of development including 
embryonic, fete! infancy, e«ly and late childhood, early and late adol«cence and 
adulthood. In referring to a temporal yardrtkk, TUP require, a form (REFSYSFORM) 
that evaluate, to a point on the yardetkk and a .election of yardstick (reference 

of irritability occurs between 7 and 9 p.m. on April 27th, 1086. 

'From immtdittofar after, to iaSaitely far in the future. 
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CALENDAR 



Example 5 



8P.M, SUNDAY, 
APRIL 27TH, 1966 



1 HOURS 




Figure 2.4: Illustration of assertion of example 4. 



(MEL i88SJHSftBBSS2LEM«-»o 



cftSaTSHr (TYPE pom » 

COHTEXT-1) 



(RREL 



REFSY8F0XN "EID-AOOLE 
(REP8YS DEYELOPMEIT) ( 

COHTEXT-2) 




-IHTERVAL) 
POIMT)) 



An extremely simple use of the context mechanism is Ulustrated by example 5. 
Two alternate assertions are given to describe the relation between the end of adoles- 
cence and the end of the asthma-prone interval. In the first assertion, in COHTEXT-1, 
the asthma-prone period ends with adolescence; in the second (COHTEXT-2) it ends 
any time after the end of adolescence. Whereas in example 5, the context slot is 
bound to an isolated atomic symbol, it is used by THRIPHT to bind full-fledged, 
structured hypotheses. 
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Although the role of asserting temporal position with respect to the present 
will not become apparent until the section dealing with temporal reasoning, ex- 
ample 6 present, a preliminary introduction. The lelationToPre.ent awertional 
form (form 2) is translated to the two RREL. shown. The first RREL establishes the 
relation between the current inrtance of the present (represented by a point whose 
event name is a unique VOW) and the onset of asthma. The second RREL assert, the 
relation between this latest instance of the present and the current time obtained 
from the host computer. The latter point is treated identically to other points on 
the calendar reference system. Example 6 then roughly correspond, to: asthma 
began twelve to thirteen months ago. 

Form 2 



(RelationToPresent 
<point> <lower bound> <upper bound> <context>) 



Example 6 



(RelationToPresent 

SiJo^iKiW iF** BEGIM-INTERVAL)) 
(♦12 MOMTHS) (+13 NORTHS)) 



translates to: 



(RREL (<HAME (GEHSYM MOW)) (TYPE POUT) 

riViJSSS^l (TYPE BECII-IMTERVAL) 
(-13 MOMTHS) (-12 MORTES)) 

(RREL ((REFSYS CALEIDAR) 

JKJTff !* i5 AT FP,C?JWE POIMT)) 
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[ <ASTHM>T). 



13 MONTHS 



12 MONTHS 



NOW001 



SECONDS 



L 



SECONDS 



I 



"8 pm June 2, 1966" 



3 



CALENDAR 



Figure 2.5: Illustration of assertion of example 6. 

On many occasions, one may wish to directly assert temporal relation, between 
intervals without explicitly specifying the position of the onset and end of each inter- 
val. Just such a functionality is provided by the interval-based temporal reasoners 
developed by Allen [1] and Vilain [61], that employ thirteen different interval rela- 
tions. These thirteen relations can be conveniently used in TUP (form 3) as shown 
in example 7. 

Form S 



(INTREL 

<iSi:£ai 8fitS3* r¥ * 1 two> 
<context>) 



Example 7 



(IHTREL ((NAME IRRITABILITY)) ((IANE AMOREXIA)) OVERLAPS) 



translates to: 



■ ■^h^^^r?-^*- ■■*"■*' 
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Figure 2.6: nhutratkm of «H<rtioB of example 7. 

Si.-"", T? ?" MIm -* rtkm ' ,w «"«»«<*>* -«t. the 
•ddrtnd drfWt tampor.1 «latfc». b*w« th. b^todn, M d end 

of each interval (iiaing ASSHtT-IITHtVAI. w in form 4). 
Ut^» U ^- e T™ ta " fr ° ,n iDto ™ 1 to P "*- 1 -^ «pre«mutkm are tab* 

STJKS& Z,tmT" ' ,hMW, " ,d mM " ■"— tot ^ 

Form 4 



(ASSERT-IMTERVAL <int.rv.l .pocification> <co«f xt» 
translates to: 
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(RREL C(<point specification^ (TYPE BEGIH-IHTERVAL)) 

((<point specification^ (TYPE ERD-IMTERVAD) 
(0 SECOMDS) (♦IHFIMITY) ««WAL;; 

<context>) 

The examples above show a variety of temporal assertions that are represented 
internally m a single uniform manner. The method by which this internal represen- 
tation performs temporal reasoning is discussed in the following section. 

2.2 Generating Temporal Inferences 

Every time additional temporal information is acquired, new relations may be gen- 
erated or any of the temporal relations, currently represented in the data base, 
modified. In this section, I describe how these inferences are computed. 

2.2.1 Range Addition 

If an RREL is asserted that shares a point with another RREL, TUP attempts range 
addition to calculate the bounds on a third RREL— that between the two unshared 
points. Range addition is simply the calculation of the sum of the two lower bounds 
and the sum of the two upper bounds. The rules for range addition for all values 
including oo and e are given in table A.2 in appendix A. 

Let us take, for instance, the assertions of example 8, in which the assertion is 
made that the onset of irritability precedes the onset of anorexia by two to three 
days and that the duration of anorexia is three to four days. The lower and upper 
bounds on the third relation, (diagrammed in Figure 2.7), as calculated by range 
addition, are five days and seven days respectively. 

Example 8 

(RREL HJJ" JSSIJ*!?"!*) (TYPE REOH-IITERVAL)) 
(RREL HSiLS tiSSRltl JUS! K5GII-IMTERYAD) 




r 



ffep*i£r 
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2.2.2 Constraint Propagation 

If an RREL r s , such that i-^j, is asserted between two points ij which are already 
related by . -±j TUP determines if r, constrains n. An RREL is constrained if the 
values of its upper and lower bounds are brought closer together, be it by increas- 
ing the lower bound, decreasing the upper bound or both. A state of maximum 
constraint is achieved when the values of the upper and lower bounds are identical. 
If the lower bound b greater than the upper bound, the temporal data base is in 
internal contradiction (is inconsistent). 

To continue with the example, if it is subsequently asserted that the delay from 
the onset of irritability to the end of anorexia is exactly five days (as in example 9) 
then the RREL originally computed can be inodined--** constrained. Here, the 
bounds on the new assertion (example 9) are narrower than those of the RREL that 
was obtained through the range-addition of the RRELs of example 8. And so, the 
RREL is constrained (see Figure 2.8). 

Example 9 

(RREL ((NAME IRRITABILITY) (TYPE BRGIM-IMTERVAL^ 

Every time an RREL is constrained, range addition is attempted with each of 
the RREL's neighbors (RRELs with one time point in common). This range addition 
may either constrain a previously asserted RREL, create a new one if no prior one 
exists, or do nothing if the range addition does not constrain extant bounds. In 
this example, the first neighbor that might be chosen is the first RREL of examples 
This results in a range addition of (-3 days, -2 days) and (5 days, 5 days) for a 
result of (+2 days, +3 days). Fig. 2.9 shows that this result constrains the upper 
bound of the RREL between the beginning and end of anorexia to three days. As 
this process of constraint and range addition is recursively repeated every time an 
RREL is constrained (whereby constraint propagation), this latest constraint causes 
yet another range addition: (-3 days, -3 days) and (5 days, 5 days) with a result of 
(2 days, 2 days) that constrains the corresponding RREL as illustrated in Fig. 2.10. 

Although TUP attempts the remaining range additions, there obviously cannot 
be any additional constraint propagation as all three RRELs are maximally con- 
strained. As Vilain and Kauts [59] have shown, such a constraint propagation 
scheme has order n» time complexity. In outline, constraint propagation causes 
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Figure 2.8: Initial Constraint. 




Figure 2.9: First propagation of constraint. 
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Figure 2.11: Propagation of the "OVERLAPS* Assertions. 
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Figure 2.12: Constraining the "OVERLAPS" assertion. 
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where r,r, ere RRELs which were used in a range addition to calculate the bounds 

^TlT the , foU<Mrm « ■"*>■. to *~ *• *»««•»*• P*th. from any RREL to the 
original external amertoons on which the bound, of that RREL depend.. A similar 
scheme was described by McDermott [36] 

2.2.4 Contradiction Handling 

If, during the process of constraint propagation, a contradiction is detected, the 
contradiction handler is invoked. The contradiction handler', basic strategy is to 
offer a lfat of externally asserted RREU for withdrawal and to continue to do so until 
no more contradictions are detected. 

Withdrawal of an assertion invokes more than merely deleting a single RREL TUP 
ha. to examine all other RREL. for whfch the ertermtf,, withdrawn* RREL (that we 
will call Ihe .«***«*.,* rrel) wasesupport. If this withdrawal of support ceuern a 
decree in constraint in a second RREL, then this RREL must in turn be (temporarily) 
withdrawn from all supports. This proems mom. until there cease, to be any 
further decrees, in constraint. Subsequently, all thorn R1EU whom constraint was 
weakened by 'the withdrawal of the iacomfctent REEL are automatically re-asserted 
by TUP (with consequent constraint propagation). 

This proem, of dependency-directed backtracking is computationally expensive, 
and is therefore only intended for use in small applications involving only a few 
hypotheses. Otherwise, for large, reilL.tically-.l~d applications, such as medical 
diagnosis, the context mechanism is used a. it permits several hypotheses to be 
repeatedly examined and compared with each other at minimal cot . 

One of the more challenging teaks, a. yet unresolved, b the aiitomatk selection 
of the incontinent REEL to be withdrawn. One method is to attempt to withdraw 
those premises, of those in mutual ceatradk^, that am leart supported by other 
RREL.. As many rock methods that solely rely on the domanvmdei>endent, syntac- 
toe information of the temporal data base, this method is incomplete and unreliable. 
Domain knowledge is required to imderrtaiid why a partkular temporal assertion 
is unreaeonable. We know for instance, that acute hepatitis B would have to foUow 
rather than precede infection with the Hepatitis B virus, but this would not be 
obvious from the temporal relatio n aloiio^ had to Imow scmeth^ 

mJ£a££' ******* ******* * , « r « «*«* **« «*>« *•* by TUP'. inf««c. 
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atitia, or infection, in general. It is precisely to provide this external or "real-world" 
knowledge that THRIPHT i- equipped with temporal templates for each hypothesis 
(described in section 3.4). 

Linear Programming and Contradiction Handling 

Linear programming has been considered as an alternative to constraint propaga- 
tion [34] to perform temporal deduction. As noted by VakWs-Peres [57], full linear 
programming presents some difficulties. One of these is the problem of denning 
whi<Asetsofaesertic«sareincontradietion. TUP determines this by tracing back 
the dependencies that lead to the contradiction; it is not apparent how this can 
be accomplished using the Simplex algorithm. Other drawbacks of the full linear 
programming techniques include what Valdes-Peres terms the lack of implemen- 
tational congeniality." That is, if we represent events using some particular 
representation, then the use of Simplex requires some properties of these events 
to be represented in a set of wholly different data structures. Integrating the two 
representations can be at the very least difficult, and leads to knowledge structures 
that are toss than obvious to the knowledge engineer. Abo, the complexity and 
unintuitive nature of the operations of the Simplex algorithm does not permit an 
expert system which uses the algorithm to readily generate an explanation of its 
deductive process. This contrasts with the deductions made through constraint 
propagation, where a backwards trace through the supports of an KIEL provides a 
reasonable explanation of how the bounds were computed. 

2.2.5 Tools for Studying Constraint Propagation 

During TUP's design, I developed some tools to follow the conseo^iences of constraint 
propagation upon the temporal relations already entered in the knowledge base. I 
have subsequently found these tools to be useful in guiding temporal knowledge 
engineering (see chapter 4). 

Loop Formation 

A loop in TUP is constituted of a set of n externally asserted UELs joining n time 
points to form a closed graph as illustrated in Figure 2.13. The simplest loop is 
that with three RRELs, but of course it can involve any number of RRELs. The 
interest of loop formation is that it is only when loops are formed that RRELs are 
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constrained* and therefor* that the externally averted RRELs are modified. If this is 
not immediately apparent, consider the simplest case-two RRELs, as in example 8. 
The only circumstance in which a third, distinct, externally asserted RREL will cause 
constraint propagation is if it joins the two points (BtGIft IRRITABILITY) and 
(EMD AIOREXIA) to form a loop. This third RREL, which closes the loop, provides 
an alternate path for the computation of the temporal distance between the two 
points. 

In the general case, when an externally asserted MEL closes a loop of any sise, 
it provides an alternate computation path for the bounds of all the other RRELs 
that are members of the loop. Thus in the simplest case, the closure of the loop 
with the third REEL can constrain the two previously asserted RRELs. Constraint 
propagation will also spread throughout larger loops and can propagate to the 
members of intersecting loops. 

In the current implementation, TUP highlights, on generated graph diagrams, 
externally asserted RRELs. This enables tiki visual detection of loops by the knowl- 
edge engineer, and permits her to direct her efforts in knowledge acquisition to those 
RRELs that might dose loops and tiierefsre cessrtram the temporal date base. Ihave 
found this particularly helpful in modifying uiiderconetramed disseee hypotheses. 

The Constraint Index 

The constraint index (CI) is a measure of the constraint of an REEL. It is calculated 
by dividing the distance between the upper and lower bounds of an RREL by the 
sum of the absolute value of the same bounds. 

ci~ '«*-"l 

\ub\ + \lb\ 

For instance, the first RREL of example 8 has a constraint index of (3 - 2) days 
divided by (3 + 2) days or 0.2. By the formula, the more constrained an RREL is, 
the lower its constraint index. 

The CI is calculated so that even when two RRELs have bounds separated by 
an identical distance, the RREL that covers a larger time scale has the lower CI. In 
this way the RREL that relates events yean apart is rated as more constrained than 
one relating events months apart even if the difterence between the upper and lower 
bounds of both is an identical number of days. 

*Otlwr th« MMTtiB* a* UK. UMi dmctljr coutraiu « ftwtomt, vctmiBy *m*U& 1MB.. 
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Figure 2.13: Loop Formation 
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TUP can calculate the cumulative sum of the CI's for specified group* of points 
(form 5). This is known as the group constraint index (or global constraint index 
when it includes the whole temporal data base). 

Form S 



(CI <point list>) 

The CI is useful for the knowledge engineer, because it enables quick identifi- 
cation of those parts of the temporal knowledge base that are poorly constrained. 
With the graphical display of loops, it provides an efficient tool for building highly 
constrained knowledge bases. Also, it can be used for the performance clustering 
heuristic, described in section 2.5.4. 

2.3 RREL Retrieval 

If, instead of values between positive and negative infinity, the bounds of an RREL 
are given as TUP variables as in forme, TUP attempts to retrieve the values for those 
bounds instead of asserting them and bind, the retrieved values to the variables. 
If only one of the bounds is an unbound TUP variable, TUP first asserts the RREL 
replacing the variable bound with infinity (positive if upper bound and negative if 
lower bound) , performs the retrieval operation, and then binds the retrieved value 
of that bound to the variable. 

Form 6 

(RREL <point 1> <point 2> ?<LB-var> ?<UB-var> <context>) 

In a temporal knowledge base with exhaustive constraint propagation, this re- 
trieval computation simply returns the one RREL linking the two points specified. 
As described below (section 2.4), the retrieval process becomes somewhat more 
involved with clustering. 

TUP also provides retrieval functions for temporal relations built on the RREL. 
For instance, if an unbound TUP variable instead of an interval type is specified in 
an IMTREL, TUP tests the RRELs between the two intervals and returns the interval 
relation that is consistent with the RREL relationships. IF, as is often the case, the 
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RRELs are insufficiently constrained, TUP returns a disjunction of interval relation! 
that are consistent with that state of constraint. Conversions from rants relations 
to interval relations can be found in table A.3. 

2.4 Restricting Constraint Propagation 

Temporal reasoning, as described in the preceding section, is uniform and ■traifht. 
forward. Unfortunately, computation of constraint propagation becomes burden- 
some in typical medical applications where each hypothec contains hundreds of 
event.. With the first attempts at developing application, that use constraint- 
propagating temporal reasoners, more attention has been paid to the tractability 
imue. It has become apparent that the time complexity is in large part due to the 
attempt to achieve breadth of expression while ensuring complete and consistent 
temporal inference. Veldts-Peres [8TI and VUuin and Kauts [ft^ have examined this 
tradeoff and have also developed representations that permit inference with order 
n time complexity »KiL T».;~* r j n j ni gfrf^j - M n ^ mf y_ 

Unfortunately, even n 1 complexity is much too high. To process, in real-time, 
several simultaneous hypotheses, each involving hambeds of events, rec^ires a much 
shallower performance curve. The improved performance is necessary as TUP to 
meant to be an accessory program for an expert system and not the primary com- 
putational activity. 

Other than this pragmatic objection to unrestricted constraint propagation, 
there are several reasons to believe that such constraint propagation is not nec- 
essary. * 

With unrestricted constraint propagation, all temporal relations are used to 
obtain maximum constraint. Nonetheless, experience with TUP has shown that 
in practice, only a small fraction of temporal relations in the data base need be 
used to obtain maximum constraint (more on that later in tak section). Perhaps 
non-coincidesAs% t tWs olenjpwtion 

or review all our remembered even* to estimate the temporal distance from one 
event to another. This intuition appears to be borne out by cognitive experiments 
described in chapter 5. 

Most temporal reasoners use some form of "divide and conquer" to allow tempo- 
ral inference to be performed on subsets of the events (efu**«r«of the temporal data 
base) that are small enough to prevent tile computational burden from becoming 
onerous. In those temporal inference engines that use constraint propagation, the 
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usual approach is to select a cluster of events and then precompute (through con- 
straint propagation) the relations between them. Thus, to overcome the complexity 
of his interval-based constraint propagation algorithm, Allen [1] uses the reference 
interval to cluster intervals in a durint hierarchy. Constraint propagation is limited 
to reference intervals such that relations between intervals in different reference in- 
tervab must be obtained by means of a search procedure. Alkn notes that "Hone 
is careful about structuring the reference hierarchy, this [local constraint propaga- 
tion and the search procedure] can be done with little loss of information from the 
original complete propagation scheme." 

Similarly, to manage the steep growth in execution time of the DEVISER I plan- 
ner, Vere [68} employs a form of temporal clustering. DEVISER n associates a 
temporal scope with each goal activity. This allows the planner to exploit the goal 
hierarchy by selectively retrieving events within the temporal scope of the goal 
activity. One of the advantages of Vere's solution is that it does not require the 
knowledge engineer to perform the difficult and laborious task of temporal cluster- 
ing. 

Unlike Allen's and Vere's temporal reasoners, those of Mittal [41] and Kahn [25] 
both have heterogeneous representations and cluster schemes. Mittal's temporal 
data base maintains three nested types of temporal organisation: event clusters 
(events clustered around a selected time), episodes (event clusters organised around 
key events) and episode clusters (clusters of recurrent episodes). All three of these 
aggregation methods perform a role equivalent to clustering; by grouping events 
according to some particular criteria, the retrieval mechanism can quickly focus 
on a small subset of the total data base. Kahn's [26] temporal reasoner has three 
parallel representations: before-after chains, the date-line and the position of events 
relative to key events. The third representation clusters those events for which the 
key event has shared importance. 

The heterogeneous internal representations suffer from fundamental difficulties 
in retrieval, namely the problem in deciding which representations to use and in 
which order to use them to obtain the most precise temporal hiformation. e In their 
implementations, such data bases use several heuristics to make retrieval decisions, 
for example employing those representations or representation combinations that 
are most frequently successful. 

In the sections that follo w, I describe how TUP implements clusters and then 

n dmom i*form*tion thw. mrekiig ta« dato-liM to tmpead to a particular qury. 
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how these clusters can be automatically generated. 

2.4.1 Implementation of Clustering: The Reference Set 

In the point specification in an RREL assertion, one of the qualifiers available is 
the REFSET that specifies reference set membership. Events can belong to more 
than one reference set, and therefore a reference set qualifier can specify a list of 
memberships as in example ll. 7 

Example 11 

(RREL (gJJgDYSPIEA) (type BECII-IiTElVAL) 

(RREL ^R^^cSSg^isT?)^ 11 - 1 ^^ 

( (TYpTroiIT))' MBI0PAUSE " 0ll8ET '' ) (RKF8YS D8VEL0PMERT) 
(-6 YEARS) (0 YEARS)) 

Definitions: 

• Osteopenia -+ decreased bone density, 

• Rheumatic fever -► on acute disease that follows infection with 
specific types of the streptococcal bacterium sometimes leading 
to cardiac involvement. 

• Rheumatic heart disease -*■ heart disease caused by rheumatic 
fever. 

• Dyspnea-* shortness of breath. One of the many etiologies for 
dyspnea is heart disease. 

Given two RRELs n and r, such that » -^j and j -^ A, reference sets modify 
constraint propagation by only calculating the range addition of i '-^j and j -^ A 
if the intersection of the reference set membership of points i, A is non-null. This 



7 Th«M temporal aaaartios* an meant to d«crib« mati in am individnal patiant modal, md not 
a population hypothaak. 
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effectively limit, constraint propagation to .ingle reference set. unless there is a 
significant degree of overlap between reference sets. Even then, a. shown in Fig- 
ure ^2.14, propagation can only spread from one reference eet to another if an REEL 
within the overlapping area is constrained. Note that points within reference sets 
are exhaustively interconnected by IftELs. 




Legend 

I 1 Point event 



L...» Reference 



set 



Mew constraint 
RREL wbieb can be 
effected by new constraint 

RREL which cannot be 
affected by new constraint 



Figure 2.14: Effect of Reference Set Configuration upon Constraint Propagation. 

Oncethe temporal data base is clustered into reference sets, the relation between 
Jwopoints can no longer be simply obtained by retrieving the one HSL that directly 

TUP, the bet-first search attempts to find thai patii between the two points specified 
that provides the most constrained values fee the temporal relation. Thfc search is 
guided by a cost .valuator that determines which node expansion (i.e. which RREL 
to select) will give the minimum cumulative cost. 

The A* search [10] could be implemented if, in addition to cost of the path 
searched so far, the cost evaluation function would estimate the cost of the path 
remaining to be traveled. In the current implementation, only the first part is 
calculated (by repeated range-additions). A first cut at obtaining a function that 
estimates the cost of the path remaining to be trs^nratd w«^ be to make very 
large cost estimate, for those paths that traverse reference sets that do not connect 
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to the goal point.* Another, unimplemented, method for increasing the efficiency 
of the search would be to make it bidirectional-etarting searches from both points 
and meeting in between [30]. 

When the search explores a reference set, it only requires one node expansion 
because of the exhaustive interconnections within reference sets. Also, by definition, 
it never takes more than the traversal of one MEL to move from one reference set 
to another. Therefore, in the worst case, the maximum depth of the search is twice 
the number of reference sets. 

2.4.2 Costs of Clustering 

Clustering the temporal data base does incur some costs in terms of the quality of 
temporal information retrieved. These costs are minimised by judicious selection 
of the reference sets. Discussion of the criteria for the selection of reference set 
membership is deferred to section 2.4.4. 

As RRELs in separate reference sets do not affect 9 their respective state of con- 
straint, an RREL wholly within a reference set is no longer guaranteed to be max. 
imally constrained. In practice, if the criteria for the selection of reference set 
membership are followed closely, assertions of REEL, within a reference set will con- 
tribute most, if not aU the constraints within the reference set, and consequently 
little is lost by ignoring temporal relation, outside the reference set. Even so, if 
the RREL retrieved is deemed insufficiently constrained by the user or expert sys- 
tem, a best-first search can be initiated 10 that will use information throughout the 
temporal data base, rather than just within the reference set. 

For the same reasons that maximum constraint can no longer be guaranteed 
for RREL. contained within a single reference set, no guarantee can be made for 
data base-wide temporal consistency. However, since constraint propagation within 
reference sets does ensure local consistency, many inconsistencies will be detected. 

In the unlikely event that an undetected inter-reference set inconsistency occurs, 
there is no easy solution short of eliminating the reference sets and permitting 
unrestricted constraint propagation. Even in this rare eventuality, I think this 
inconsistency will not be of m ajor consequence to the performance of the host 

'A precompiled couMctiritjr map of nhnmu Mti could b« uawl for tfua pwpoM. 
•Exc.pt occMioMUjr i» tfc. cee of ovwfeppiaf rtf«r«c mU dbcMd tbov*. 
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2.4. RESTRICTING CONSTRAINT PROPAGATION 43 

expert system. Using the most recent example, If one of the RRELs within the 
rheumatic heart disease reference set were to be inconsistent with the RRELs in the 
osteoporosis reference set, this probably would not impede diagnosis of either of 
the two conditions at long as the reference sets were internally consistent (which is 
guaranteed by constraint propagation). 

2.4.3 Computational Savings 

What then are the computational savings that one can expect from the use of refer- 
encesets? With two hundred point events in a hypothesis, unrestricted constraint 
propagation would create approximately twenty thousand RRELs. The same two 
hundred points clustered into twenty refsmnce sets of ten points each would gener- 
ate approximately One thousand RRELs. That is, the number of RRELs grows linearly 
with the number of events rather than with the square of the number of events. 

The space savings are much less than the savings in the time required for prop- 
agating all the constraints since the computation time for constraint propagation 
increases with the cube of the number of events. With reference sets of uniform slse 
the time for constraint propagation grows linearly with the number of events." 

The impact of these savings can be appreciated by considering the performance 
of TUP with a hundred point events. Without reference sets, the space capacity of 
the machine" was exceeded after more than one hour of computation whereas with 
ten reference sets, of ten points each, the time for constraint propagation was 45 
seconds. 

2.4.4 Design of a Temporal Clustering Heuristic 

The overriding motivation in the design of a clustering heuristic was that it re- 
flect the goal that led to the creation of clusters in the first place: computational 
tractability. In the context of constraint-propagation-baeed reasoners this means 
that relations that are retrieved often should be precompiled whereas infrequently 
retrieved relations can span clusters and therefore require search. This clustering 
by frequency of retrieval differs markedly from schemes that cluster by temporal 
location. Althoug h temporal proximity or contiguity may generate clusters with 

"Of coem, tk~ Hriaei will b. mffifcd if mm, of tea eetries, •ebetqttaatiy i»ft to TUP, require 
uttarawferaac* m* Matte. 

"A xrnox 1108 reaaiaf DfTSXUSP 0. 
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the desired properties, there are many domain application, where this wUl not be 
the case. 

With most clurtering schemes, if the knowledge engine* to not careful, too many 
of he relation, retrieved will require the relatively expend search procedure. 
In the case of Allen's reasoner, since relations between Interval, within the same 
reference interval are computed locally, there may extot inference paths that include 
interval relations outside the reference interval that would inlbr a more constrained 
relation. Similarly, inconsistencies that would be detected by the original constraint 
propagation algorithm might be overlooked. The knowledge engineer must therefore 
be careful not to omit from a reference interval theee intervals and relations that 
might increase the constraint of the relations contained. Deciding « prior.- which 
of the relations will be retrieved frequently to, as Allen suggests, a difficult task 
It requires that the knowledge engineer understand and anticipate much of the 
dynamics of the performance program. In a medkal expert system this involves 
knowing which temporal relations might be pivotal in differentiating hypotheses 

Take for example the case of a sixty-year-old woman who ha* received a blood 
teansfusion and ha. jaundice. An incidental finding of osteopenia to noted on the 
basis of an abdominal X-ray taken during the work-up. A medical expert or ex- 
pert syrtem should consider the pcesibility of a blood-borne viral liver infection 
and m differentiating this hypothecs from other cau^ of jaundice, the temporal 
relation between the transfusion and the onset of jaundice will be much more im- 
portant than the relation between the jaundice and oateoi^enia. The former will be 
therefore retrieved more frequently for compaxtoon with oti» hyi»theses than the 
latter. Fortunately, in many applications much information about the mutual im- 
portance of events to already encoded in the knowledge ttructuree. Thto knowledge 
engineering practice was advocated by Bobrow and Winograd [«, page 267] : 

One of the fundamental problems in artificial inteUtojence to the ''combi- 
natorial explosion." A large knowledge base provides an exponentially 
expanding set of possible reasoning chains for finding desired informa- 
tion. We believe that the solution to this problem must be found by 
dealing with it directly through explicit concern with the oeeMMeOity of 
information. The representation language mart provide the user with 
a set of facilities for controlling the way in which memory structures 
are stored, so that there will be a correspondence between "salience- or 
"relevance" and the information accessed by procedures for search and 
reasoning operating under processing resource limitations. 
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Even if such correspondence is not always a conscious concern of the design- 
ers of knowledge representations, the demands of computational tractability will 
frequently push development in that direction. Otherwise, the combinatorial explo- 
sion mentioned above, will grossly impair the performance of the applications that 
use the representation. 

The parallel between salience and the accessibility of information in knowledge 
structure , can be exploited by temporal r«*»er. to create ch-ters or clusteThl 
erarchie. that parallel those of the atemporal structures. The Salience Clustering 
Heuristic (SCH) does just that. ■ 

To obtain the expected improvement in performance with SCH, the knowledge 
structure, must fulfill the criteria lfcted below. The* are illustrate in the example 
m Section 2.4.1. 

• Parallel salience. There must be correspondence between atemporal and 
temporal salience. That is, in the particular application being considered, 
there must be some explicitly represented atemporal organising principle that 
groups together the events linked by ia^wtant (frequently retrieved) temporal 
relations. Although in most planner, object-orknWd, and process representa- 
tions such correspondence exists, this is not necessarily the case. 

• Cluster Sise. The maximum cluster sise depends on the particular flavor 
and implementation of temporal inference, the machine it is implemented on 
and ^the maximum time for temporal inference that is acceptable to the user 
of the performance program. 

• Disjointness. If there is too much overlap between clusters, and constraint 
propagation frequently spreads through the areas of overlap, then the effective 
cluster sise will be significantly increased. SCH therefore works best when the 
clusters are mostly disjoint. 

2.5 Automatic Generation of Reference Sets 

THRIPHT use. SCH to derive reference set membership from the cauaal aggregation 
hierarchy used in representing each hypothesis (Figure 2.15, page 47). The imple- 
mentation detail, are deferred to chapter 3, page 82. Here, I discuss whether the 
causal aggregation hierarchy is an adequate substrate for SCH by examining the 
applicability criteria itemised above, but first, a few definitions are in order. 
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Causal link., a. used here, are skeletal versions of those used in the ABEL pro- 
gram. That is, a causal link is a relation between two event, such that the onset of 
the causally antecedent event is simultaneous with, or before the onset of the causal 
consequent and the likelihood of the causal consequent c«currii»g k increased if the 
causal antecedent occurs » Although a truly usable impknnentation of a diagnostic 
medical expert system would require a more powerful representation of causal as- 
sociation, I have found this definition sufficient to demonstrate the role of temporal 
reasoning in causal-association-based systems. 

A ^aggregate is* summary* the * 
detailed level. As in ABEL, the more detailed level b represented by a network of 
events, which themselves may be causal aggregates, mterconuected by causal links. 
Parallel salience: Each causal link, by its nature, has an associated set of 
temporal constraints, imnimally that the onset of the e«*t foUows, or is simulta- 
neous with the onsrt of the cause. For „„„, of computational parsimony and 
epistemic sufficiency, only the relevant causal links are explicitly represented. In 
this application, medical diagnosis, the important causal links are those that are 
characteristic of dtoeas. hypotheses. The time constraint, between cause and ef- 
fect are intrinsic to this characterisation. Since the orgenismg principle-causal 
aggregation-encapsulates networks of causal links within an abstracted descrip- 
tion these aggregated links must have some amtual relevance. The i>arelW betwesn 
the relevance of causal links and temporal leletkms ensures that temiwral clusters 
based upon causal aggregation will group mutually relevant feeinporal relations. 

An example: as diagrammed in Figure 2.15, Inoculation and Jaundice will fall 
within the reference set Prodrone/Acute -Hepatitis. The temporal relationship 
between the two is important for arriving at the diagnosis of hepatitis B since it 
permits a whole host of other hypotheses to be dismissed (or at least ranked low 
m ^the differential diagnosis). In the case of a patient with a history of transfusion 
(the putative inoculation) followed by prodromal signs and symptoms (e.g., malaise, 
chill, and fever) , if the delay between transfusion and jaundice b between 50 days 
and 7 months (a range corresponding to the viral mcubaticm period) the hypothesis 
of Mood-borne hepatitis B gains weight. If the prodromal symptoms follow the 
transfusion by couple of days, a blood-type mismatch is much inoro likely. 

In contrast, the temporal relation between the inoculation and the onset of 
recovery (which do not share reference sets) is considerably less useful for diagnostic 
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purposes because it is 10 variable (and can extend to a iifeipan if the patient develops 
chronic active hepatitis). This illustrates another property of parallel salience: that 
temporal relations within clusters are usually more constrained than those between 
clusters. Why this is so is unclear: perhaps more effort is invested in obtaining and 
asserting more precise estimates of the temporal rdatkioshUM that are characteristic 
of a disease and on which diagnosis might hinge. Alternatively, events that are 
closely related to a particular causal mechanism might have less variable timing with 
respect to one other than with respect to events that are only indirectly related to 
that mechanism. 14 In any case, this is useful as it means that most of the constraint 
in the computation of an MEL can be obtained locally within a cluster. This helps 
minimise the loss of information that Allen mentions regarding reference intervals. 
Cluster Sise: The number of events that are included within a reference set 
depends upon the number of levels of the causal aggregation hierarchy that SCH 
uses. With unabbreviated medical hypotheses, each causal aggregate has five to 
fifteen elements. In the current implementation of TUP this is at the upper bound 
to achieve anything approaching real-time performance. Consequently, THRIPHT 
directs SCH to gather only the immediate elaboration of a causal aggregate within 
a reference set. 

Disjointness: Within a particular hypothesis, only one or two events are shared 
by causal aggregations. The effective cluster sise is therefore approximately the 
same sise ss the reference set membership. 

It seems then that events with the same immtHaie causal aggregation share 
the criterion of relevance necessary for membership within the same reference set. 
Note that temporally distant events (as in our earlier example of rheumatic fever 
and mitral stenosis) may share the same immediate causal aggregate and therefore 
share reference sets. Also, the component events of a causal aggregate are not 
necessarily DURI1G the aggregate. For instance, the immune response to a Hepatitis 
B infection persists into the recovery period. 

2.5.1 Using Other Knowledge Representations 

Most if not all knowledge structures are built with some regard to processing re- 
source limitations and thus indirectly to the salience of the entities within the knowl- 
edge structures.This includes the whole spectrum of knowledge representations: 
causal aggregation hierarchies [45,50], structured object representations |6,48,40] 
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goal structures of planners [58], qualitative system description. [17,29,13] and the 
more recent hybrid knowledge representations such as KRYPTON [7] and KL-TWO 
[60]. When, as in the previous example from THRIPHT, temporal salience follows 
atemporal relevance, SCH can be brought to bear. I outline below some of the 
promising candidates to which SCH can be applied. 

2.5.2 Qualitative Reasoning 

In qualitative simulations [17,30,13] the number of events, and associated temporal 
relations, grows rapidly with the number of p roc es s es modeled, especially if there 
is significant interaction between these processes. Williams's [64] approach to mak- 
ing temporal queries computationally tractable is to generate justification histories. 
These histories maintain the dependencies between the quantity values at differ- 
ent times. Temporal reasoning can therefore be safely restricted to those events 
that share membership in a justification history. Nevertheless, in large simulations 
such as models of human physiology, the extent of interaction between processes 
will create justification histories that again contain too many events for reasonable 
performance in temporal reasoning. 

SCH, however, can exploit the effort already invested to "chunk" process de- 
scriptions a la Qualitative Process Theory [17] by using the pammeUr histories [17, 
page 28] associated with the Individual, in a process description (Figure 2.16) 
to determine reference set membership. By definition, the Individual, (and as- 
sociated parameters) in a process description (s.d and path in the example) have 
greater shared relevance" than they have with other individuals in other process 
descriptions. 

What about SCH's requirement for parallel temporal and atemporal salience? 
Clearly, this depends on the application so let us take a typical medical application 
of qualitative simulation: explanation of the causal mechanism of pathophysiological 
phenomena [29]. 

An adequate explanation of the causal behavior of a system must include a 
partial order, if not quantitative chronology, of the events in the behavior. It is es- 
pecially important, if the explanation is to be consistent, that the timing of events 
which are tightly coupled (closely related to a shared mechanism) be as precise 
and consistent as possible. It is less important to ensure precision and consistency 

15 In describing a particular meckaaiam. 
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process: fluid-flow 

Individuals : 

■ a contained- liquid 

d a contained-liquid 

path a fluid-path. Flttid-Connection(s.d.path) 
Preconditions : 

ftligned(path) 

QuantitvConditions: 

A [Pressure (s)] > A[Praaaura(d)] 
Halations : 

Lat flov-rata be a quantity. 

flow-rate PMP0RTIMAL-T0 A [Pressure <s)] - A [Pressure (d)] 
Inf luancas : 

I* (Anount-of (d) . A Cflow-rata] ) 

I- (Anount-of (a) . A [f low-ratej ) 

; ir'i^S.i'i^ogn 4 otay lf • ithwr 1% *-- **™ 

Figure 2.18: Process Description of Fluid Flow. 

between events that are less tightly coupled or related to completely separate mech- 
anisms. For instance, there is a greater need for precisiem in describing the timing of 
decreased oncotic pressure" and subsequent increase in transudation 17 than for the 
timing of decreased oncotic pressure and the onset of a low protein diet." Precision 
m the timing of decreased oncotic pressure and the tremor events of Parkinson's 
disease is even less important as their respective mechanisms are distantly, if at all, 
related. In this last case, timing information would not contribute to the under- 
standing of the dynamics of either m^h.^frm 

Observe that we seem to have more precise temporal information (BRELs with a 
lower constraint index) about tightly coupled events thaa about loosely coupled or 
unrelated events. As in the case of causal-association networks, this is likely due to 
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the greater effort inverted in obtaining and aMcrtiag more precise estimates of the 
temporal relationships of thoee event, whkh are tightly coupled to, and therefore 
characteristically aeiociated with the behavior of a inechaniem. Or, each additional 
intermediate mechanism, between two events, adde an increment to the variability 
of the temporal relation between thoee event*. 

The parallel between temporal and atemporal salience permits SOH to take the 
union of the events of the jwrameter hutorU* seeociated with the Individuals in a 
process description and lump them in a reference set so that their temporal relations 
are preeomputed by constraint propagation while relations between evente m differ- 
ent processes are obtained by eeareh. The ptoesssm that taterect, and therefore 
share parameter histories, have correspondingly overlapping reference sets. As in 
most applications of SOH, the usual caveats regarding potential loss of information 
apply. 

2.5.3 Planners 

Planners have the properties of parallel salience and disjomtness that "i-frr clus- 
tering effective. That is, most of the temporal relations asserted within a plan 
are between actions sharing the earns proximate supetgoal a major reason Verc's 
clustering scheme works. Application of SOH to a planner goal hierarchy simply 
involves declaring a goal to be a reference set of the subtree of goals it subsumes. 
The depth of the subtree is determined by the cluster rise criterion. That is, SCH 
ia applied recursively until the number of pissmed events in each subtree is within 
an acceptable range. 

2.5.4 Frame-based and Hybrid Representation Languages 

Languages such as KRL [6] and KX-OHS [S] have the breadth of expression to provide 
many taxonomic distinctions with which to drive SCH. Whether this taxonomical 
structure can be used in a particular application depends on the extent to which 
the criteria for SOB are met. This must be determined by the knowledge engineer. 
Take K*L»s ssrsseettvet: from one perspective an individual can be viewed as 
a traveler and from another at a customer. By definition, the components of a 
perspective share a common view or re l ev a nce . Temporal salience may follow that 
imposed by a perspective, for example: the timingof events in the trawler perspec- 
tive (e.g. geographical movements) have greater mutual salience than they have 
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with custom* perspective events («.g. book piirchascs). If the reference Mts gen- 
erated by perspective, are too large they can b« subdivided using other taxonomk 
structures of the language such as the SetOf set membership specification. 

KL-ONE and its derivatives attempt to distinguish between the descriptive, ter- 
minological component of a representation and the assertioaal component. KRYP- 
TON implements the former as the TBox and the latter as the ABox. The TBox is 
used to build descriptions of the world, "the formal oquivnient of noun *A«we* such 
as 'a person with at least three children*- [7, page 4i«] from which the logical con- 
sequences (such as subsumption and disjointaess) of assertions made in the ABox 
can be retrieved. The TBox provides a rich terminology with which to describe 
the roles that concepts fill and the manner in which concepts are specialised. This 
terminology provides many dimensions with which to group concepts with shared 
salience. For instance, concepts which fill the same role 



Unlike process descriptions and causaMink-based hypotheses, these last repre- 
sentations are much more general and domain independent. The parallel between 
the atemporal clustering and the shared salience of the temporal relations is do- 
main dependent and may not always hold. Therefore, a Imowladge engineer cannot 
borrow knowledge structures from other applications and hope to effectively use 
SCH without first verifying that the parallel holds in the new application. 



Performance Driven Clustering 

All the above cases use domain-dependent knowledge of the salient decomposition 
of the domain knowledge to drive the clustering of th» temimral data-base. Could 
this clustering be done automatically and yet wholly internally to TUP without 
knowledge of the domain? 

At the beginning of the discussion on clustering the temporal data-base, I as- 
serted that creating a duster on the basis of a purely temporal criterion— especially 
temporal proximity— was unhelpful as it did m»t capture any notion of mutual rele- 
vance rf the inenmer events of the cluster. However.mthe course of my work in this 
area, it has became apparent that TUP has access to several dues to the domain- 
dependent salient decomposition even while restricting itself to introspection upon 
its own operations. First, the frequency of retrieval and assertion of certain RRELs 
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relative to others in the data-base provide, strong guideline, for the correct 18 refer- 
ence set configuration. Second, the pattern of distribution of the constraint index 
would also point to the correct reference set decomposition; those connected 10 por- 
tions of the data-base possessing a significantly lower CI should be assigned to the 
same reference set. 

A version of TUP, modified to perform temporal clustering in the manner de- 
scribed above (performance-driven clustering), would start with a collection of as- 
sertions upon which no constraint propagation had been performed. All retrieval. 
at this initial stage would use the search mechanism. After additional RRELs would 
be asserted, performance would degrade as the search paths became progressively 
longer. Upon reaching a threshold of poor performance, the performance-driven- 
clustering version of TUP would bring to bear several heuristics for clustering the 
data-base into reference sets. Once the reference sets were denned, constraint prop- 
agation would be initiated within each reference set. The boundaries of these ref- 
erence sets would be re-evaluated by the heuristics as additional data were ac- 
cumulated and more queries made. As the configuration of these reference sets 
approached the natural decomposition of the knowledge in the application domain, 
the reference set configuration would become increasingly stable. 

The heuristics that would be employed would have to be precisely tuned so that 
the criteria for reference set membership were neither too stringent nor too lax. 
The high-level strategies would, however, be: 

• If a group of connected, externally asserted RftELs have an individual assertion 
rate x times higher than other XKELs to which they are connected, then make 
a reference set out of the members of this group. 

• If a group of connected, externally asserted IRELs have an individual retrieval 
rate y times higher than other REEL, to which they are connected, then make 
a reference set out of the members of this group. 

• If a group of connected, externally asserted RftELs have an individual con- 
Btraint index s times less than other RtELs to which they are connected, then 
make a reference set out of the members of this group. 
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• If a proportion n of the reference set. have membership, greater than m 
event., modify the threads of the first three heuristic, to make reference 
set membership more stringent. 

• If a proportion i of the reference sets have memberships less than j events, 
modify the threahoid. of the first three heurirtfc. to make reference set mem- 
bership more lax. 

I find this scheme of performance-driven-clustering quite intriguing, because it 
creates a temporally-oriented memory that progretsivery organise, iteelf so that 
tnos« .temporal relations that connect events that are cfceely related are those that 
are the most easily retrwved. It aho guarantees temporal con*tency for thcee tem- 
poral relations that connect closely related events, In contra*, temporal relations 
that ere rarely retrieved, between event, that are not very relevant to one anoth«, 
require considerable effort (search) for retrieval. 

2.6 Reference System* and Reference Sets 

The earlier description of the commonly used temporal yardsticks (reference eye- 
term) such as the calendar, was purposefully left incomplete pending the dsKiuston 
ofcoiistramtpropagatk>nandth«therokofrel«B«^.. I omitted the fact that 
when ith. mini-expert of each reference syrtem ae^ ten^oral relation, between 
member, of a reference syrtem, constraint propagation cauM. the exhaustive fa- 
terhnkmg of all member, of this reference .yUm. Thh conrtraint propagation is 
restricted to the reference system by the creation of a reference set that contains 
only members of the reference syrtem. This reference set is created by the mini- 
expert ; which appends to each point everted a reference set who* name is that of 
the reference system as in example 12. 

Example 13 

(RREL (OtEFfffg CALENDAR) 

(CREfSTS CALENDAR) 

(REF81T CALENDAR)) 
(2 H0UE8) (2 HOURS j) 
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These mini-experts have knowledge of the temporal distance between point* 
in a particular reference system and are implemented as black-boxes that only 
provide TUP with the distance between two points, specified in canonical form. 
The internal operation of these black-boxes is quite varied, the CALEIDAR mini- 
expert uses a simple formula to obtain temporal distance between points whereas the 
DEVELOPMEMTAL mini-expert has its private temporal context with range relations 
from which it obtains this distance information. 

Early in TUP's development, one of the problems that arose was the inability to 
use reference system information from within (non-reference system) reference sets 
without having recourse to a search. In Figure 2.17 (a) the RREL linking points a 
and 6 is less constrained than the RREL that could be obtained if a search which 
included the reference system information (along the path a -> dl -> 42 -* b) was 
performed. Nevertheless, since retrieval of an RREL between two point events in 
the same reference set is done directly and without search, the reference system 
information is not employed. 

In general, one would like to be able to always use reference system information 
to constrain RRELs within reference sets because these reference systems are ubiq- 
uitous, and particularly because the constraint index of these reference systems is 
usually very low. The CALEIDAR reference system, for instance, has a total con- 
straint index of sero as all relations within that system are maximally constrained. 

The solution adopted involves adding points of a reference system to the ref- 
erence set of those events to which they are related by external assertions (Fig- 
ure 2.17 (b)). By dint of constraint propagation, the RREL between a and 6 is then 
appropriately constrained by the calendar information. Note that because of the 
restrictions on constraint propagation imposed by reference sets, range addition is 
not attempted between RRELs exclusively in the JIT reference set and those exclu- 
sively in the CALEIDAR's reference set. Therefore the only way that constraint could 
propagate from the X reference set to the CALEIDAR'. reference set would be if an 
RREL within the region of reference set intersection were to be constrained. 

As reference systems have a low CI, the direction of constraint propagation is 
usually from the reference system to the local reference set. Only rarely does it occur 
that RRELs within a reference set constrain relations in a reference system. When it 
does, as might happen for instance, if a reference set were to contain an assertion of 
early DEATH then one would want all reference sets that contained events bounded 
by DEATH to be appropriately constrained. This in fact is what would happen under 
the rules of constraint propagation as modified for reference sets. 
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Figure 2.17: Use of Reference System Information. 
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*u * *! ^ *" 80lUti ° n ad ° pted remaiM *"" *° the Uitm °«f of reference sets- 
that only ckeely related event point, be included in the same reference set.. In this 
case only those point, in the reference system that are externally asserted to be 
related to points in a reference set are included hi that reference set. 

2.6.1 The PRESENT Reference Set 

ftZTr 8 ^ ^ tk,a,hlp ' rf "™* *** '-P** *> the pr«ent are typically 
found throughout the temporal data-base, involving event, of several different ref- 

7TZS*? f 3 "* " m0,t m * aX * m * *• PWM °* m i«««^d by means of the 
RelationToPreaent assertion, most MOW eveat. will be directly linked to a time 
and date. Consequently, just as reference system* are a source of tight constraint, 
so are reference, to the present . Therefor^ the same solution adopted for reference 
■«ta was implemented for MOW inrfance.. That b, aU iutance. of MOW are made 
(by RelationToPreeent) to be member, of the PURVT reference .*. Abo, a. for 

of the point specific in the RelationToPx^ot exertion. Abo, by the mechanbm 
described m the previous section, the reference set information of thb MOW point 
is appended onto the reference set membership of the CALEMDU point that repre- 
sent the current time and date . The final r^ 
complete version of example 6. 

Example IS 

(RelationToPreeent 

^HASSLA 8 *?**) (TYPE BBGIM-IMTERVAL) 
(♦12 MOITHS) (*13 MOMTHS)) m *~"' 



translates to: 



(RREL (<MAME(GEMSYM MOW)) (TYPE POIMT) 

( ftiSL£ ST ? a) (TO* BEGIM-IMTDIVAL) 
(-13 MOITHS) (-12 MOMTHS)) """"" 

(RREL ((REFSTS CALEM0AR) 
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<*|FSYSFOW< (DATE)) (TYPE POIHT) 

2.7 Predicates and Retrieval Functions 

Up to this point, I have described much of TUP's functionality, without touching 
upon the practical aspect! of using TUP in a medical expert system. Although the 
REEL can be used to assert and retrieve all temporal information, the direct use of 
the REEL form in most applications is at the best cumbersome. For this reason, 
TUP', implementation includes a broad variety of predicates for testing different 
kinds of temporal relationships and a few specialised retrieval functions. 

2.7.1 Predicates 

The nature of the REEL makes for two kinds of tests of temporal relations. One 
kind determines whether the specified condition could sossiWy be true while the 
other kind tests whether these conditions are strietfy true. For each TUP predicate, 
there consequently is a corresponding strict* 1 and a relaxed version. Take the 
WITHIM-P predicate, it tests whether two time points fall within a specified distance 
of one another as in form 7. In the strict version (S-WXTIIM-P), the predicate 
returns "true" only if both the upper and lower bounds of the REEL between the 
two time points are less than or equal to the specified distance. The relaxed version 
(WITHIM-P), will return "true" as long as one of the two bounds is less than or equal 
to the specified distance. Subsequent constraint propagation may further constrain 
the REEL such that the WITHIM-P predicate might return false.- By definition, 
as S-WITHIM-P is the strict version of the predicate, it never changes the value it 
returns from tree" to false", no matter how much the tested REEL is constrained. 
In practice, the relaxed predicate versions are tile pragmatic choke for knowledge 
engineering in application domains where temporal fawwiedge is poorly conitndned. 
All the implemented TUP predicates are described in appendix A. 

Form 7 

(WITHIM-P <point 1> <point 2> «llstance> <context>) 
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2.7.2 Event Retrieval 

TUP implement, event retrieval (as oppoeed to MEL retrieval) with the GETEVEHT 
function which has the form: 

Form 8 

(GETEVEHT <point epecification> <filter> <context>) 

where the filter is a boolean combination of TUP predicate.. If the point speci- 
fication. (e.g reference set membership) match a point (or point.), and the filter 
return, "true , then the point(.) matched are returned by the function. This per- 
mif the retrieval not only of event, of a particular type or name, but alao with a 
specific temporal relationship with respect to other event.. 

FIIDBETWEEI and FIHDPQSITIOB 

There are some applications in which one i- interested in the event(.) that occur 

p™r^ t ^ Md ^ Md ^^^ rfMTOtm »^ of ^^. The 
FIIDBETWEEI and PIHDPOSITIOI function, (as. form 0) provide thi. capability. 

Form 

(FIMDBETWEEM <point i> <point 2> <.cope> <context» 



(FINDPOSITIQM <point> <point aet> <context>) 

k J^!!! 8 ^™ 1 fonCti ° n ° ht9inB ^ **•»«*«<>» of •» the events returned 
by GETTO1T that are after the first point, with all the event, before the second 
point. There » a strict and relaxed version of thk function, the only difference 
being whether strict or relaxed BEPOBE-P and AFTEB-P predicates are employed; 
the relaxed version of FXBDBETVEEI tend* of coume, to return a greater number of 
events. 
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When someone ask., -What has happened today?" your answer will depend on 
what category of events you believe the questioner is referring to. To a doctor you 
might enumerate the various symptoms you have experienced, while to a business 
associate you might enumerate the transaction, of the day. The scope parameter 
of the FIMDBETWEEI function permits the specification of a list of reference sets to 
wMchtiiefunction should be applied. In addition to delimitmg the categories that 
FIMDBETWEEI will be applied to, this scoping reduces the expense of a very expensive 
computation. Of course, if necessary the scope can be specified to include the whole 
temporal knowledge-bee*. 

FIMDPOSITHM returns the ordinal position of a time point in a set of time points. 
It does this simply by counting the number of events in the set that are BEF0BE-P M 
the specified point. There is no need for .coping as the ecope implicitly only includes 
the points that are members of the point set. I have found however, that in most 
realistic, large application., the point set k too large to be directly specified, but 
instead is used with the FIIDBETWEEI fanctkm as in example 14." Therefore, in 
practice, the FIMDPO SITHW function incurs approximately 50% more computational 
expense than FIIDBSTVEEI. As discussed in chapter 5, this phenomenon ha. its 
parallel in human cognition. 

Example 14 

(FIHDPOSITIOH 

(GETEVEIT [gg^nO^ (TYPE BEGII-IITERy*L)> 

(nnma AeBJM ^;4 :g: gmr. gaggu^ 

*AU.-DISfita-IIPElflCS-reT8*)) w **" i " Mfc " 



Although these function, are indeed very expensive relative to other TUP re- 
trieval operations, it is my experience, at least in the domain of medical diagnosis, 
that they are infrequently needed. 
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2.8. PERSISTENCE 

2.8 Persistence 

Any event in THRIPHT has a persistence that is bounded by the interval in TUP to 
which it is associated. Often there is some initial knowledge of the extent of this 
persistence («.g. we know a priori that cardiac angina without ischemia does not 
last several hours) that is an intrinsic property of the event. Abo, the persistence of 
an event is bound by the persistence of other event. (e.g. the duration of diabetes 
melhtus is limited to an individual'. Hft»pan). Thta is repressnted in TUP by having 
the end of one interval tied (with an IBEL) to another. The mutual restriction 
of persistence that this interdependence represent! is taken care of by constraint 
propagation. For instance, every time the lifespan duration is shortened, so is the 
persistence of diabetes mellitus. 

There are, however, many events whose persistence remains completely un- 
known TUP makes the same assumption in this regard that a lot of people would 
make: that the persistence extends to infinity-* Watt until further knowledge is 
gained about the intrinsic persistence of such an event or the persistence rf another 
event to which it is tied. For example, the duration of the interval that represent, 
the persistence of the planet 1^^ existence wfl have an upper bound of +00. To 
hedge the bet, there could be another event— the destruction of the Earth— whose 
corresponding interval would have an onset rimnHaneoustotheendof theexi.tence 
of the planet. The moment the dkcovery was made that planet, .uch as the earth 
had a .specified limited lif«p»n or that there would be planetary destruction in lew 
than infinite time, the infinite persktence of Earth's exbtence would be constrained 
accordingly. 



2.9 Unresolved Issues 



TU f *T J"" d * WgMd *° «*"" ****** k«^J«i^«il«i«»llya.po»iblewhile 
maintaining a .imple underlying temporal representation. Even so, tup's perfor- 
mance falls short in the representation of certain kinds of temporal information, 
specifically: recurrent event., probabilistic distribution of temporal bounds and 
parametrisation of bound.. 
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2.9.1 Reasoning With Temporal Uncertainty 

Several temporal reasoning system*, capable of hypothetical reasoning through the 
use of contexts or some form of backtracking (or both) are billed as endowed with 
the ability to reason with temporal uncertainty. In some sense this claim is correct, 
but only in a restricted sense— as will be explained shortly. 

Let us see what kind of reasoning about temporal uncertainty is permitted by 
context and backtracking mechanisms. If the temporal representation is used in 
an asstrtional mode, a backtracking mechanism permits the temporal reasoner to 
correct prior assumptions as additional, possibly unexpected, information is ob- 
tained. In this sense, the temporal reasoner is handling uncertainty as it responds 
to events whose occurrence cannot be fully anticipated. If the temporal representa- 
tion is used in a descriptive or terminological manner, alternate, distinct temporal 
hypotheses can be described as well as the logical (temporal) conclusions that derive 
from specific temporal relationships. Here again, the temporal reasoner can be de- 
scribed as reasoning about temporal uncertainty, because it handles the uncertainty 
over the "real" timing of events by representing several different possible temporal 
configurations. 

THR1PHT exhibits both the assertions! and terminological methods of dealing 
with uncertainty in its use of tup's reasoning mechanism and representation. In the 
data-gathering (first) phase of history-driveii-diagnosis, inconsistencies detected by 
TUP cause the withdrawal of one or more RRELs and the subsequent recomputation of 
the consequent temporal relations. The terminological representation of uncertainty 
is illustrated by THRIPHT's alternate causal/temporal hypotheses generated in the 
elaboration phase. 

Encoding Probabilistic Information 

Both of the above methodologies for representing temporal uncertainty are too weak 
to express more detailed temporal knowledge. In particular they do not allow an 
expert system to make use of probability estimates of temporal relations. In this 
section, I sketch some of the challenges of providing such a capability. 

Let us take two RRELs used in previous examples, and suppose that we could 
assign a prior probability of pj to the temporal relationship of the first REEL and p, to 
the second RREL (see example 15). What would be the probability of the third RREL 
linking onset of anorexia and end of irritability? To begin with, the question itself 
is flawed, because the semantics of RRELs are such that the RREL bounds between 
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two point events are not determined probabilistically, but are the fixed limits for 
that temporal relation in a specific TUP context. Any other interpretation renders 
the results of the range addition operation m^in^^ 

Example 15 

(RREL (OIAME IRRITABILITY) (TYPE BRCII-IRTERVAU) 

\ftBJm& ( 5So^ JJ)") I,rmvAL)) 
CRREL J8B 0K8 SR mEBBBff* 

(72 HOURS) (06 HOURS) (SiorVM)) 

We can, however, redefine the semantics of the RREL so that in our example, 
the interpretation of the first RREL becomes: -There is a probability n, that the 
temporal distance between the onset of irritability and the onset of anorexia lies 
in the range of two to three days.- The operation equivalent to range addition 
should then either calculate the bound* of the third RREL at a pre-set probability 
p3 or calculate the probability pZ for a particular pair of bounds. Either of these 
two operations really requires not just a single probability estimate, but in fact 
the probability distribution of the temporal distance for each pair of event points. 
Since the probability distribution of a calculated RREL depends on the probability 
distributions of the two RRELs used for tile calculation, this capability would require 
that TUP be capable of performing the equivalent of range addition on any pair of 
arbitrary probability distributions. 

Let us go a step further, and imagine that the probability distributions, over the 
full range of temporal distances, were represented for each RREL. Just as in the case 
of the range addition calculation, there would be several combinations of RREL. that 
could be used to calculate a particular probability distribution. The problem would 
then arise of how to resolve the differences between the probability distributions 
calculated from different RREL combinations. 

Although this is a difficult problem, in the absence of a solution, the manner in 
which temporal reasonen deal with temporal uncertainty will remain, at best, ad 
hoe and subject to inconsistent interpretations. In this respect, the recent work in 
mathematical reasoning with partially specified systems of equations" appears to 
be a promising line of research, ff we could provide the reasoner with the general 

a *Aj exemplified by Sack.' [53] Qualitative Maiftenatkei Runnier. 
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form of the distribution (e.g. normal distribution) as well as a few values along this 
curve (e.g. 75% of individuals have symptom x within five days of symptom y), 
this might sufficiently constrain the set of consistent probability distributions to the 
point that useful temporal calculations could be made with them.Note, however, 
that in medicine at least, temporal information of quality sufficient to construct 
a temporal distribution is scarce, 86 and therefore probabilistic temporal reasoning 
would be infrequently useful. 

2.9.2 Recurring Events 

Due to the significant difficulties in providing a general facility for reasoning about 
recurrent events, few temporal reasoners have tackled this problem. Describing 
these will be simplified by first defining a recurrence as an event that occurs more 
than once in a temporal context. A collection of recurrences constitute a recurrent 
pattern. 

In one cut at the problem of representing recurrences, all recurrences are enu- 
merated (asserted), as is the interval of the recurrent pattern of which they are 
members (as is done by Mittal [41]). As a result, the recurrences appear to the 
temporal reasoner no differently than other, non-recurring events. The interval of 
the recurrent pattern similarly appears as just another interval with temporal rela- 
tions arranged so that each recurrence is during that interval. It is hardly feasible, 
however, to enumerate highly repetitive recurrent patterns with large numbers of 
recurrences (e.g. the cardiac rhythm). 

Kandrashina's [26] "T-Model," partially implemented in the VOSTOK system, 
follows another approach to the representation of recurrent events. In this approach, 
several different types of recurrent patterns (-chains- in the T-model representation) 
are defined, and a set of generic relations between these patterns is specified. As in 
Figure 2.18(a), the "chains" of the P waves and QRS complexes are synchronised in 
a particular relationship (ALTEWATIOH in T-model terminology) with respect to one 
other during the course of the normal recurring pattern of cardiac electrochemical 
activity. 

Where this last approach performs poorly is in specifying occasional modifi- 
cations in the temporal relations of the recurrent pattern. Take for example, an 

"Notable exception* include the survival curve, for various diseases and compilation* mcb at the 
Denver Developmental Screening Test [18] which chart, the percentile of patients that manifest a 
particular sign of development at different ages. 



'■■■;*8g-3l«^s£!is i *assj*- : - 



2.9. UNRESOLVED ISSUES 




Figure 2.18: Pattern, of P Wave, and QRS Complexes in ALTERMATION. 

electronic recording of thousands of cardiac cycle., in which one (Figure 2.18(b)) 
or more recurrence, have prolonged P-R interval.. It is difficult to um a generic 
recurrence repreaentation, of the T-model type, to represent this information and 
in particular to make .uch temporal deduction, a.: 

• The temporal relation, between the event, on opposite side, of the perturbed 
recurrence. This require, combining the generic information of the recurrent 
pattern and that of the local variation, of that pattern. 

• The total duration of the pattern. 

Obviously, a constraint propagation mechanism could make all these inferences, 
but only if all recurrence, were enumerated-iardly an elegant solution and gener- 
ally not feasible. 

What is required is a dichotomous temporal reasoning sy.tem. One part would 
represent, by explicit enumeration, those temporal relations that differ from the re- 
current pattern. The other side of the system would represent the generic recurrent 
patterns. A mapping would have to be maintained, finking the recurrent patterns 
to the enumerated events. One of the major difficulties in the design of such a 
system would be to maintain the mapping and spotting inconsistencies between the 
two halves of the dichotomous representation. 

THRIPHT and TUP together implement a poor man', version of the above scheme. 
TUP maintains the temporal relations of the enumerated portions of the recurrent 



i^^i^i^^ 
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patterns. THRIPHT maintains recurrent patterns as abstracted events 87 with ad hoe 
specification of the maximum number of references and the bounds on the interval 
containing the entire recurrent pattern. Clearly, this is not satisfactory, and the 
implementation of the system, described above, is one of the more pressing items 
on the agenda for further research in temporal reasoning. 

2.9.3 Parameterized Bounds 

In a patient history, there rarely is any need, or sufficient medical knowledge, for the 
use of parameterised bounds. However, when the diagnostic domain is one of the 
more thoroughly investigated physiologies, such as acid-base homeostasis, there is 
sufficiently detailed medical knowledge to take advantage of parameterised bounds 
of the kind illustrated in form 10. As shown, instead of explicit numerical values, 
the bounds are represented as functions of vectors of quantities. 

Form 10 



(RREL <point one> <point two> f(Qi) g(Q2)) 

The implementation of parameterised bounds would require that every time the 
value of a quantity changed, all RREL. whose bounds depended upon that quan- 
tity would have to be updated. If the constraint of 0mm IRELs were to increase, 
constraint propagation would proceed as previously described. If the change in the 
quantity caused a decrease in constraint in any ERELs, TOT would behave as if it 
were withdrawing these tftELs.** 

The fact that TUP does not represent RfiKLs as probability distributions cre- 
ates some difficulty in using parameterised bounds. Take for instance, the use of 
parameterised bounds to describe such functional dependencies as the expected pe- 
riod of survival of an individual exposed to high levels of radiation, as it varies 
with the cumulative exposure and the nature of this radiation. Unfortunately, be- 
cause the temporal estimates that arise from parameterised bounds are usually of a 

37 Whkk than become the nfanece eats of the nevmaees. 

J^Ht^ZLT^ ********* *■ *■" ««^w^-^rfeo M i™«l«Up«drf.pontli. 
state of tli* BABLs whoee coaatraiat had bwt weakened. 
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probabilistic nature, 29 temporal inference errors would be generated, as previously 
discussed. 



29 In the case of the radiation exposure, there is a probability distribution of survival for each 
exposure level. 



3. Application of TUP to Medical 
Diagnosis 



THRIPHT is a medical expert system prototype, developed in order to investigate 
the kinds of temporal reasoning required for the task of medical diagnosis. Early 
in its design, I made the decision to avoid a relatively simple graft of TUP onto a 
"vanilla" rule-based system. This would have involved adding TUP predicates to 
those already available for the construction of rules, and permitting the assertion 
of TUP temporal relationships in the date base as in example 16. 1 As the limited 
range of knowledge representation and the limited control structure that such a 
system provides would have been inadequate to support the scope of the multi- 
stage diagnostic task outlined in the introductory chapter, I have instead chosen 
to build a prototype expert system using several of the "second generation" AIM 
technologies. These include: causal aggregation hierarchies (e.g. ABEL [46] and 
CADUCEUS [50]), knowledge structures for reasoning about hypothesis evocation 
distinct from those employed to perform causal reasoning within a hypothesis (e.g. 
CADUCEUS' constrictor and causal hierarchies), and the concurrent construction of 
several alternate patient models rather than building and dismissing hypotheses one 
after another. This system— THRIPHT— is skeletal, incomplete and far more brittle 
than the systems whose concepts it borrows. It has the merit, however, of bringing 
together in one system the features that are necessary for the investigation of the 
temporal issues in medical diagnosis.' 



Example 16 



IF (BEFORE-MOW-P 

((NAME JAUNDICE) 
(TYPE BECIN-INTERVAL))) 

(BEF0RE-N0W-P 



1 Before the medically knowledgeable reader protest*, I emphasise that this example is meant to 
illustrate the use of TUP predicates and assertions in a rule and not detne the necessary criteria for 
hepatitis. 

3 Its implementation also had the merit of not exceeding the available (my own) man-power. 
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( $2&£ IV-DRUG-ABOSE) 
AND E BEG "-WTaiVAL))) 

(S-BEFOBE-P (UAJg IV-DRUO-ABUSE) 

THEH (TYPE BECH-MTERVAL)) 

(EelationToPreaent 

(♦EPSIUW) (♦IIFHITY) ) 

•J?*?!"! ^ T 10 "" "^^ d ** lt Pri^P* 1 ^ "** temporal representation 
^j^ ^ ****"* *• t " ,po ^ ■-**• **«* (TUP) and a medkd 

diapter 1) for decomposing *. ^ * Mrt^«« «^^ i ^JTS^ 

Ido not claim any ckee analogy to human cognitton or that U*^enJVahy 

more "correct* than other*. It does h »■■■■■ m^uil _ , 1L , "^ 

^ JMr . . _ "***"*• " oow aemmm conveniently organise the exploration 

3.1 Data Collection 

ST ^T^?* »*«»**» *V r^uire, and are «M. to p«fam f^ 

Pa^^^T^ Ontheoth.e^eme.I 

P«iv« eyrtem. accept whatever data it profofd (or fa available) and then proceed 
^k^tewconch^io^ 

tr^^^r"""' ^ *" ^^-^^^^t^^butmayafaoprJmpt 
the ueer to provide eoene pertinent detaib. 

*^<^t implemented of TK^ 

SSTiSTf "IS S? *• ^^P^^^^^-^P^it-ofthemiL 
mrtiative^e. In earlier version, of THWPHT, the mixed initiative paradigm w« 
afao adopted for the dat^collection pha* «> that a fow he^tk. couWull te 
eiiwrethecc^Mt^Mvaadprecfaionofthedata. If externally amerted REEL', were 
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found to have a CI much higher than average, THRIPHT would phrase a question to 
attempt to obtain more constrained information. Similarly, THRIPHT would check 
selected derived RREL's by asking the i»er if the derived information corresponded 
to her understanding of the temporal distribution of events. 8 THRIPHT would also 
initiate a -canned" set of questions for significant findings; for instance if melena* 
was reported, this would cause THRIPHT to query the user about related events 
such as pallor, loss of weight or anemia. As described earlier, THRIPHT has been 
designed as if it were to operate in the background of an automated medical record 
system using the information gathered to check if any important or likely diagnostic 
hypotheses had been omitted. Therefore, the current version of THRIPHT is purely 
passive in its data-gathering phase. 

All assertions that are made to THRIPHT in this data-gathering phase are as- 
serted a. RREL's in the REALITY context-the default when no context is specified. 
Constraint propagation is performed upon the assertion of each RREL. This per- 
mits the frequent temporal inconsistencies in the history to be detected early in 
the diagnostic process before any significant effort is wasted upon hypotheses based 
upon erroneous data. As this data-collection occurs prior to the generation of any 
hypotheses there isn't any applicable domain knowledge to guide the clustering of 
the temporal data base into reference sets. During this phase, reference sets could 
only be generated arbitrarily and with a higher risk of missing important inconsis- 
tencies. For this reason, all RREL's are asserted within the same reference set to 
ensure global consistency. As this phase usually involves no more than 20-30 point 
events, exhaustive range addition is not too computationally demanding. 

Whether implicitly (through the tense of a verb) or explicitly, most temporal 
assertions obtained in the patient history contain a reference to the temporal po- 
sition of the specified event(s) with respect to the present. To represent this, the 
RelationToPreaent assertion is used with virtually every datum gathered in this 
first phase. For instance, the phrase "the onset of fever began two days before the 
rash" not only indicates the relative position of the fever and rash but also the fact 
that the onset of the fev er occurred prior to the present. Example 17 provides the 

'For instance if ft*, patient ««rW that the fever happened two to three days before the raah 
and the rash four day. before the jaandke, the patient comld be asked if she believed that the fever 
preceded the jaundice by six to seven days. 

'Stool stained by blood pigment*. 

'Experienced physicians will generate a small group of working hypotheses [27] early in the taking 
of a patient history. " 
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equivalent assertions in TUPese. 
Example 17 

The consequence of the ubiquitous reference to the present is that all events 
in the history become solidly anchored with respect to the present and indirectly 
(by means of the expansion of the RelatioaToPresent assertion-see example 6 
on page 24) to the calendar reference system. As the calendar reference system 
has a very low overall constraint index, these frequent references to the present are 
helpful m constraining the temporal relations of the patient history. 

3.2 Hypothesis Evocation 

There usually are many hypotheses that include findings that correspond to those 
in the patient history and yet which a human expert would only briefly consider, 
if at all. One reason for this is that for a Urge class of hypotheses, their temporal 
patterns are wildly at variance with the chronology of the events in the patient 
history. Therefore, to correctly trigger hypotheses for further consideration, the 
expert system must be sensitive to the temporal configuration of events in the 
patient history. Unsatisfactory results will ensue if just the presence or absence of 
events is used to evoke a hypothesis. This is clearly illustrated by the three examples 
of mistaken diagnosis of transfusion-borne acute hepatitis B in the introductory 
chapter. 

Temporal Errors In Human Expertise 

Human beings who ignore temporal course are subject to the same errors and inef- 
ficiencies to which temporally unsophisticated expert systems are prone. One such 
error will have occurred to anyone who has taken several patient histories. A pa- 
tient will mention several symptoms, say a prior episode of jaundice and malaise, 
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and is then ^asked routine question, to refine the diagn<*i*--in this case whether 
the patient ha. received blood tran.fu.ion.. An affirmative answer will occasionally 
incorrectly lead the interviewer to believe that she is on the right track only to 
discover that the event happened at a time other than one relevant to the hypoth- 
esis (e.g. the transfusion occurred after the jaundice). That is, the hypotheses the 
interviewer consider, may lead her to expectations that, without sufficient temporal 
cues, will be incorrectly matched to finding, reported by the patient. The converse 
phenomenon will also occur: the patient omit, a symptom because it is outside 
the temporal window the patient considers to be relevant. A classical case of this 
» the patient who ha. been diagnosed as having had a myocardial infarction or 
end-stage emphysema and is asked if he smokes. Often the patient will respond in 
the negative, and it only becomes apparent, later in the interview, that the patient 
started to abstain a month previously, after a fifty-year, two-pack-a-day history of 
smoking. ' 

The Usual Approach 

When a medical expert system is developed, the system's inability to recognise a 
wide variety of temporal patterns of disease leads the knowledge engineer to assume, 
often implicitly, one or both of the following two "solutions". 

The first solution is to assume that the user will go some distance in arriving 
at a diagnosis and therefore only feed* the expert system those event, that are 
pertinent to the present illness. In a complete patient history that includes multiple 
visits such assumptions can lead to erroneous conclusions. For example, MYCIN 
tests for a bacteroides infection with the following rule [12]: 



(1) the infection is priaary-bactereaia. and 

(2) the site of culture is one of the sterile. ana 
the suspected portal of entry of thVorganiS is^the 
gastrointestinal tract. *^ m 



s^ris'bajsssjsir • vld • ac • ( - 7) *■• *• idwrtit * * «- 

Regardless of when the primary bacteremia occurs it can bind to the correspond- 
ing slot in the rule. Therefore, even if the primary-bacteremia happened months 
before the current culture was obt ained, MYCIN would come to the same conclusion 

•AfterO, a*, of the god. of AIM k to prod™ program, tkst op«*e «wr the whok lifetime of 
a patient end that take into acconnt events of clink*! importance throughout. 
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as if the bacteremia had happened just a few hours before the culture. Also, if the 
patient had multiple episode, of primary bacteremia, each of the bacteremia events 
could be matched to the antecedent part of the rule. The user is therefore expected 
to assert bacteremia only if the episode was recent enough to be relevant to the 
present illness. In doing so, the user has to engage in diagnostic activity because 
temporal proximity does not necessarily imply relevance to the present illness.' For 
instance, an episode of acute rheumatic fever that causes valvular disease 30 years 
later should be reported to the expert system even if it is not temporally proximate 
to the present illness. If we intend to develop AIM systems that can work with naive 
users we cannot shift it any of the responsibility for recognising relevant findings 
from the expert system. 

An alternate solution, and probably the one most commonly employed, is to 
permit the program to trigger freely upon the whole patient history and let the 
expert system discover* at a later phase that the facts do not quite fit. For instance, 
if the post-transfusion hepatitis B hypothesis was triggered by the jaundice that had 
occurred in infancy and and a recent transfusion during caesarian section, the fact 
that the serologies (for the various hepatitis B antigens and antibodies) were all 
negative would most likely cause the hepatitis hypothesis to be ranked low, if at 
all, in the differential diagnosis. This method, however, involves the exploration 
of many solutions (and requests for information) that are irrelevant at a glance to 
clinicians familiar with the disease chronology. Often, even if all the atemporal 
mformation is available and is used, the expert system will be unable to make 
distinctions for which temporal representation is necessary. It is apparent, then 
that providing expert systems with the capability to represent and reason about 
the temporal course of disease permits a significant pruning of the diagnostic search 
space— even at the hypothesis triggering phase. 

Consequently, if a l arge-scale diagnostic program is endowed with the ability to 

'Tab critkkm of MYCW may app«r ufefc aac tk. ^t«m «Wlrw.id-ck«m«» from tk. h y- 
poth— tota. <Uu ud tk«fer. tk. tiamg of tk. „«* «, b. tMkitly ck«W by q««rymg 
Jl^'J^^T^^^^****^ W •»•«»» *ata ba» a«l »»vld. «ke 
^^T^t'^^ ■*** *» MYCW <— * ^ *• ««*P««1 »l*k»dup from prior 
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-- - eoasidwd. Tkk k atMeaptebk if * patkst hktory it to b« 

^ ??ir!T ******** *""« » «a»^--b«*w«d<ayaiagwo-Jdta«h.v. 

*°. * ™^ d *■" *°° m "» kypoia^. (S) if th. r-k k *~d « . f«rw«Uluinmg mod., my 

ongmd d«m t tk* tk. u~* k- to tea, « «th» rok i. (•*«•*« tk. diff«ntUi dkgno.k, hold.. 

•On purely .temporal ground.. 



74 CHAPTER 3. APPLICATION OF TUP TO MEDICAL DIAGNOSIS 

support sophisticated temporal reasoning, its diagnostic style shows a greater degree 
of focus; that is, a more relevant set and smaller number of diagnostic hypotheses 
are considered. 

How Much is Gained? 

Let us put aside, for the moment, the reduction in the number of questions that a 
more focused diagnostic style would bring to ask the following question: To what ex- 
tent does the use of temporally sophisticated hypothesis evocation lead to improved 
expert system performance? 

One way I could show that the computational savings are substantial would be 
to pit THRIPHT against an expert system without the capability for temporal rea- 
soning. Both systems would be presented with a set of run-of-the-mill cases that 
a physician might see in the course of a week's practice. The time that each ex- 
pert system would require to reach a final diagnosis on this typical case-load would 
provide statistical evidence of the relative performance of the two systems. This 
method has not been tried because THRIPHT lacks a broad knowledge base and, 
as mentioned before, the ranking (fifth) phase of diagnosis k only partially imple- 
mented. Nonetheless, the scope of the reduction in computation can be conveyed 
by considering the three following sets of high-prevalence findings. 

1. Take the findings of a non-specific rash and bee-sting. Very many patient 
histories will contain both of these events. There are many causes of a rash 
but only a small percentage of these will be caused by a bee-sting. However, 
if a medical expert system is unable to check whether the rash followed the 
bee-sting by a few minutes, it will have to give further consideration to the 
hypothesis of an allergic reaction secondary to a bee-sting in most, if not all, 
histories which contain both findings. 

2. Many women will lactate during the course of their lives. The vast majority 
will do so towards the end of their pregnancy and during nursing. A physician 
will not consider pathological causes of lactation, such as thyroid disease or 
a pituitary adenoma, if the lactation ocean during these periods when it is 
expected. 9 However, a temporally incompetent expert system will have to 



"Unleai the diaeasM hw pro grawd to the point whan they an clinically manifeat in waya other 
than lactation. 
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farther investigate all these cases thereby using additional computational and 
clinical resources. 

3. Many patient, who are administered antihypertensive drug, will have rebound 
mes in their blood pre«ure if they are weaned too quickly from their medica- 
L~l T ^^^" whM ^^W^«i*^t«minat«d or a different drug 
is selected. The new medication might be given in insufficient dosage or lack, 
efficacy for that patient. As there are many other cau*. for incre«ed blood 
pressure, unless the change in medication precede, the rise in blood pressure 
by a speciued^riod, it is a waste of computational and clinical resource, to 
m^cat^T to * **»*'* bMed ttJHm <**"** ** *ntihyperten.ive 

drug "de-effects. Each drug ha. a characters^ delay batwm it. administra- 
tion and the effects/.ide^ffects. If an expert syrtem is able to represent this 

h™T ^ Mat ^ tt * gai,Wt **" ****** m *"» *■«■"* to*** 1 * ^en the 
hypothec, of drug-mduced effect, need only be considered in a small fraction 
of the prevalent cases of the findings. 

tripped of the description of their place in a characfrktic chronology. At least 
w .medicine .precedence information alone is i^ufficknt to adequately character^ 
re^T "" ^"^ tin ** infimuation impa^ by RREL.1t 

Early Solutions 

Developer, of early AIM program, were cognisant of 

poral representation for triggering hypothec. The Present Illness Program(nP) 
[48] for instance was modified [55] so that feature, of hypothesis frames such as 
causal and ^tioual links could have a temporal qualifier. To this end, the 

FUTTOE. This enabled PIP to repr-ent dbeee. chronologies such as the development 
tis (AGN) MOW, pip could then a utomatically infer when features characteristic of 
pe^ET"'' *■"• ** ntCmMry *** ******* tnmtdm ^v* -"*»" *» *• 
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a hypothesis could be expected with respect to the present. Consequently, pip 
would not ask the user questions about features occurring during CGN if AGN was 
hypothesized to occur NOW. 

This ad hoe solution has limitations: a large number of disease states have to 
be created,", calculations of relative temporal position lead to loss of temporal 
precision, and quantitative temporal information, as opposed to simple ordering 
information, cannot be represented or reasoned with in this manner. Other ap- 
proaches have employed the precedence relations between causal antecedents and 
consequents but, with branches in the causal chains, many inter-event temporal 
relations are indeterminate. 

THRlPHT's approach 

THRIPHT triggers take full advantage of TUP's richness of temporal expression. A 
THRIPHT trigger can consist of any boolean combination of predicates, temporal or 
atemporal. Hypotheses are triggered only if characteristic collections of signs and 
symptoms are present and only if they are in a temporal configuration compatible 
with the hypothesised disease. Example 18 illustrates part of the trigger for the 
Hepatitis B hypothesis. This example roughly corresponds to -consider acute hep- 
atitis B secondary to intravenous drug abuse if (in addition to the other criteria 
not shown) jaundice has been manifested, intravenous drug abuse did not end be- 
fore the previous seven months, and the onset of drug abuse preceded the onset of 
jaundice by at least two months."" Observe that all predicates (by default) test 
the REALITY context. Also, the trigger in example 18 has been written with the 
relaxed version of the TUP predicates so as to make the trigger more sensitive (and 
less specific). 

Those TUP queries that employ the RelationToPreeent retrieval form (see sec- 
tion A.1.4) generate, as side-effects, additional assertions. So these will not clutter 
up the patient histo ry, a query context is created 14 for these side-effect assertions. 

"Especially if temporal dktiactio**, finer thu the fi*e ,»«rioda ,«rid«d, .w to b« made. 

"e.g. If a clinical feature X k aMed to occur » the MEAI-FUTOU with r-p^t to the AGN 
*»***•* «d if AON k aMed te he* kipp-* is the TOBMT-rAOT, PIP could uot d««miae 
if X would occur MOW or iu the Nttl-PtmiUL 

"The two ud nm month. r«f«r to th. minimum aud maximum mcubatfam timee, respectively, 
of the vurui. " 

"THRIPHT rimply add* the coatext ipeeificatioa to the u«w point*. 
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The query context shares with the REALITY context the assertions of the patient his- 
tory. After the queries are completed the side-effects can be eliminated by garbage- 
collecting the contents of the query context. 

Example 18 

(AND 

(BEFORE-NOW-BY-P 

((NAME JAUNDICE) (TYPE BEGIN -INTERVALS 

(BEl;g!JS!!BYip +IIFIMITY)) 

tilulk TifriSI!?S; AB V55l- (TYPE BEGIN-INTERVAL)) 
rS^-i^flPS 02 * (TO* BEGIN-INTERVAL)) 
(+2 MONTHS) (^INFINITY))) A " *«"*»•» 

Unstructured collections of triggers will tend to cause far too many hypothesis 
triggers to be tested and then too many of these to be successfully activated. Several 
scheme, have been elaborated, the most succesrful of which has been to create 
disease clarification hierarchies so that only the relevant disease categories are 
even considered for triggering. The scheme adopted for THRIPHT is a variant of the 
one used in MDX [10} in which there is a community of .peeialUt programs organised 
in hierarchical fashion. In the MDX system, each specialist attempt, to establish 
or refine a diagnosis. THRIPHT instead use. the hierarchy to shrink the number of 
hypothesis triggered and then considered for further diagnostic activity. 

In general, each node in the hierarchy represent, a category of pathophysiological 
pathway. (d«a*e.) which should be considered if certain conditions (the trigger) are 

T^rt'^^ W * Uy hM thfee aMOci * tod tri ««»: RHLE-OUT, NECESSARY and 
SUFFICIENT If the conditions of the RULE-OUT trigger are satisfied, the hypothesis 
is excluded from further consideration. In the current implementation, triggers 

TU^ "*• betWeM1 *****" ■"* h yPoth«ses so that satirfaction of either 

of the NECESSARY and SUFFICIENT triggers cat*es the active consideration of the 
hypotheses with which they are associated. 

Evaluation of triggers proceeds from the broadest categories to the more specific 
Every time the trigger conditions of a node (pathophysiological hypothesis) in the 
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Figure 3.1: Part of the Tangled Hierarchy of Trigg. 



;ers. 
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tangled hierarchy are satisfied, all the triggers of the specialized instances 1 ' of that 
node are evaluated to ascertain whether one or more of these narrower hypotheses 
should be considered. This is repeated recursively until the most specialised nodes 
have been triggered. Once this is achieved, only the pathophysiological hypothe- 
ses at the most specialised triggered nodes are processed in the next— hypothesis 
elaboration — phase. 

Regarding the sample tangled hierarchy in figure S.l, note that THRIPHT does 
not compel the user to enter the jaundice as ADULT- JAUIDICE or IMFAIT- JAUKDICE 
as many systems do.** Rather than forcing the generation of many compound terms, 
THRIPHT enables the knowledge engineer to employ TUP predicates to test for the 
temporal relation of findings (e.g. jaundice to age). These temporal relations may 
have been directly asserted in the medical record or indirectly obtained from other 
temporal relations by means of TUP's inference mechanism. 

3.3 Elaboration 



Hypotheses that are triggered in the evocation phase are in fact collections of patho- 
physiological pathways (see figure 2.15, page 47). What brings together these patho- 
physiological pathways depends upon the classification principle used in the trigger 
hierarchy. It may be that these pathways share clinical manifestations, share etiol- 
ogy and/or share pathophysiological mechanisms. The purpose of this, the elabo- 
ration phase, and the phases that follow, is to manipulate these pathophysiological 
subhypotheses so that they may be distinguished from one another. The partic- 
ular role of the elaboration phase hi to separate each of these subhypotheses, as 
diagrammed in figure 3.3. 

Some of these subhypotheses are compatible with one another. In the hepatitis 
B hypothesis there are subhypotheses with jaundice and with an immune response, 
each of which can occur by themselves or together. Other courses, such as immediate 
convalescence after the acute phase of hepatitis, and chronic active hepatitis are 
by definition mutually exclusive. During the elaboration phase, the compatible 
pathways (subhypotheses) are grouped together in classes of compatible hypotheses 
whereas mutually exclusive subhypotheses are segregated into competing classes of 



l *n.b. Daughter nodes trigger subsets of the dimiMtlmr panels) triggers. TIm daughter nodes 
are therefore linked to their parest(s) by AKO Mass. 

"In tkoM cum when at taut some ad hoe attempt is mads to include temporal information. 
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hypothc 



3.3.1 Defining Mutually Exclusive Courses 

The exercise of representing the court* of disease as an entity that progressively 
changes over time makes it very clear that few dissasw are truly mutually exclusive. 
A program that does not represent disease chronology might represent metabolic 
acidosis and metabolic alkalosis as mutually exclusive pathophysiological disease 
states. However, a patient can have both, as in the case of the patient suffering from 
aspirin intoxication, because the mutually exclusive events are not cotemporal. One 
of the criteria for the mutual exclusivity of hypotheses » tharcsbre the cotemporality 
of mutually exclusive events. Dean's [14] temporal reasoner is designed towards 
detecting just such cotemporality. In practice however, determining cotemporality 
of events in independent hypotheses is difficult. One problem is that each hypothesis 
has to be anchored with respect to a shared point in time, such as the present, which 
the hypotheses sre not until instantiated as patient models. Therefore it is a priori 
almost 17 impossible to rule-out the co-existence of two diseases, in one patient, just 
because the two diseases contain mutually exclusive events. The only information 
that we can obtain a prion is that some diseases might only very rarely occur in the 
same patient. Obviously this does not have the same strength as asserting logical 
contradiction. 

Even when two hypotheses are anchored with respect to the present, it is not 
essy to determine if logically contradictory events are cotemporal unless the events 
are tightly constrained. Otherwise, especially if the contradictory events sre of brief 
duration, the temporal information may be insufficiently constrained to determine 
whether the two events sre strictly cotemporal. 

Even if it can be determined that contradictory events are cotemporal, there 
remains the problem of keeping the temporal reasoner free of domain-dependent 
reasoning. In the general case, it will not work to simply permit the most recent 
assertion to "clip" the duration of the earlier, opposing assertion. What is needed 
is a domain-dependent means of evaluating the relative belief in, or likelihood of, 
the conflicting events. 

The heuristic solution implemented in THRIPHT is one that is not satisfactory 
in the general case. That is, those event pain that the knowledge engineer knows 



"Almost, becuss mom disuses by defaitioe ceaaot oeesr a the same lifetime as rather dieeeee, 
m in the case of systemic hipms erythematosa* sad rhsamateM arthritis. 
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*♦* rlT" COntradictOTy ' or for Wftk * *» probability of occurring in the same 
£*""• *»own to be very small, „. Ubeled a. mutually exclu«ive in the THRIPHT 

all event, in th» hwarchy below the two explicitly contradictory event, are also 

bTn^^lT^ft!!^ 1 * *? ^ *" ** — "» «»»*P«n*-of«ch«ventto 
be mutually exclude. Even thou«h this » an ed *<* solution, it work, in meet 
case.. Take, for example, two of the possible «^aUe to Hepatitis B: the chronic 
active state and the chronic carrier state. Althon^i it k conc«vable that in a .ingle 
lifetime, a patient might have both (but at difierent time.), it might be a wa.W 
computational resources to consider this possibility. 

. A ^J^^f ****** ""^ W to ***** ***** combination, of hypothec 
calculated to be of low probability. However, a. TOUT „ „ not eo^peiwith the 
capability to repent and reason piobabffirtteaMy about events, this solution is 

«dP^^ 

3.3.2 Generating Context* 

For each ^ch. of compatible hypothec, tW i. sa a-ociaW Umporal contort. 

This context contain, the default tmnmi -^^^i-*. „ *v «*«■*». 

^ .. , "T «!! ****** tt8 * flnl co««*»iai« upon the component events 

of the* hypothec. The* coneteamte ate default one. in the mum that they 

T^^I^ * *"• tmn9 ° nl ***** «•*•«*• subpopulation of 
!f ^ riWfc »*» rt *»»N** mthe case of anymdrvidualpatknt, 
these bound, are usually further constrained. 

THRIPHT». Default Temporal Assertion. 

Otlier than the tennwral relationahiie 

automatically asserts those temporal reb*ii»«|^ that are obvious. For instance, 
for each ev^in the knowkdge base, a «m^^ mt«val i. aeaerW" Ahx> 
for all «eusa% connected events, the one* of ** emam j. amertod to precede the 

Tell 11 *? - ' ****^***~«^~*^hmm**U» 
earlier than the «»a«t of ti^paaiopfaysioieyj^ Theclinkal 
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manifestation of a causal antecedent many occasionally follow the manifestation 
of a causal consequent and so prior assertions are not automatically made about 
temporal relationships between manifestations. 

Constraints Set by the Knowledge Engineer 

THRDPHT permits the knowledge engineer to bind any number of temporal con- 
straints to each event and between any two events in a hypothesis. These constraints 
can be any assertionai form known to TUP. Upon elaboration of a hypothesis, all 
these temporal constraints are asserted so long as they constrain events within the 
same compatible hypothesis class. THMPHT appends the hypothesis class object to 
each temporal assertion made so that the hypothesis class becomes the temporal 
context of these assertions. As a result, each hypothesis class becomes paired with a 
temporal context. This pairing demonstrates the separation between the temporal 
and atemporal parts of each pathophysiological sub-hypothesis. 

3.3.3 Generating Reference Sets 

During the generation of temporal contexts, THMPHT provides the information 
that TUP uses to organise the events into reference sets. In the implementation, 
the REFSET specification is appended to each point specified in each RREL prior to 
assertion in a hypothesis context. The constraint propagation that follows is then 
restricted to these reference sets. 

As discussed earlier, the causal aggregation hierarchy is used to determine refer- 
ence set membership. First, the value of the 1*18 descriptor in a temporal assertion 
is used to obtain the corresponding (event) node in the THMPHT causal network. 
All that is then required to obtain the reference set identification is to find the 
node's immediate causal aggregation. If the node belongs to more than one causal 
aggregation, the corresponding time points will have multiple reference set mem- 
berships. 

3.4 Instantiation 

The hypotheses elaborated from the composite hypotheses (that were triggered by 
the patient findings) are not patient specific. Rather they represent shared char- 
acteristics of patient populations with the hypothesised disease courses. It is only 
when these hypotheses are modified with the information that was obtained from 
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the patient (history) that the hypotheses become patient-specific. A hypothesis 
modified with such patient information becomes a patient (specific) model. 

3.4.1 Consequences of Constraining a Hypothesis Context 

In the creation of a patient model, TKMPHT adds the REEL'S gathered in the patient 
history to those of the temporal context, paired to each hypothesis (hypothec 
context). TUP responds as usual to these additions (assertions) by propagating 
the constraints through each of these contexts. The global constraint index of a 
hypothesis context will be significantly decreased since the temporal relationships 
between events in the patient history will be generally far more constrained than 
the corresponding relationships in the hypothesis contexts. 

Another consequence of constraint propagation during instantiation is that the 
hypothesis contexts become anchored with respect to the present. All that is re- 
quired is that there be at least one MEL in the patient history that relates an event 
to the present or to the calendar. 19 

To illustrate, take but one 1BEL from the Hepatitis B chronic-active hypothesis as 
in example 19. If the patient history includes the information of example 20, upon 
instantiation the patient model will include the information that the inoculation 
occurred four weeks ago and the onset of symptoms 80 to 180 days later (that TUP 
will deduce to be approximately three to twenty-two weeks in the future). 

Example 10 

((HANK SYMPTOMATIC) (TYPE ISflll-IITOtVAU) 
CHROIIC-aCTTYE) 

Example 30 



(RelatienToPresent {(**». IPOCTUTIOI) (TYPE 1E0II-IMTERVAL)) 

w.jraog) (4 warn) 

REALITY) 



(■m Metio. 2.1.2) to ieftr tk. poiitka of potato o» tht esltedsr with r~p«ct to th« pr—nt. 
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One important co,isequence of the catmint propagation during initiation 

wiW* ^•^^^^^^^^^^iound^TUFtobeinconri.tent 
with those of the hypothesis context. Thus, even before the hypothesis evaluation 
phase some patient model, may be dtamim* becauw of temporal inconsistency, 
^e last e*unple, if the patient hktory were atao to contain the information of 
example 21 th» would place the onset of symptom, within four weeks of inoc- 
ulate which is inconsbtent with the minimum time specified in the hypothesis 
context (example 19). TUP'. coarframt propagation inechaniam would dkcoverthi. 
mconsistency upon a«ertioa of the incoadrtent IBL. TW. iUurtrate. yet again 
that providing medical expert systems with a sophfctkated temporal utUity can 
greatly reduce the problem .pace that ha. to be searched-in this cs*e by imme- 
diately Jumu-tag temporally incoi-ktent petkat inodeJs. An AIM syrtem not so 
equipped would fail to recogniae that the patient data of this last example was 
tacons^t with the Hepatitis B hypotheri. and would therefore go o^Texpend 
needless computational effort in attempting to confirm or rule it out. 

Example 21 



(RelationToPreaent 
(0JAME SYMPTOMATIC) 

REALITY) 



Multiple Finding., Multiple Event Instance. 

The process of discarding temporally inc«i^^ pa^t models goes a long way to 
solving the problem of binding multiple instance, of findings in the patient history 
to multiple occurrence, of the amine finding In a hypothesis context. To wit: in 
chronic-active hepatitis there may be a febrile epiai* during the acute period after 
moculation and eeveral eph»d«. later during the chronic active phase. The patient 
date may al» cc*tam rei«rte of one or more e|^ A medical expert 

each of the pocnbk combination, of binding, of finding, from the patient hi.tory 
to event, in the disease hypotheses. By employing a temporal reaaoner such as 
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TOT, discrepancies between the patent history and the hypothec context 10 are all 
detected by the consistency check in the constraint propagation process. THRIPHT is 
therefore able to <ikcard all those binding configuration, that are a pnon temporally 
untenable. v * 

3.5 Ranking Patient Models 

Ranking hypothec in THRIPHT is roughly patterned after the examples of ABEL 
and CADUCEUS, in that the process can be viewed a. a repeating loop which has 
three components: patient model evolution, finding features of the patient mod- 
els that makes them distinct from others-^s«ntfaaon--and obtaining patient 
information to exploit the distinguishmg features. THRIPHT'. use of temporal in- 
formation in this phase, because it accentuate, the differences between patient mod- 
els, causes a more rapid convergence to a -correct- differential diagnosis. It also 
qualitatively changes the diagnostic style of the expert system, a. described in the 
following sections. 

- „ U ! dn ! *"" four 0ther phMes d-^^ * this chapter, this phase has not been 
fully implemented-the main issues involved in such an effort lie outside the scope 
of the present research effort. 

3.5.1 Evaluating Hypotheses 

To evaluate a set of hypotheses is to sssign a partial order to the members of this set 
according to the degree of belief in the extent to which each hypothesis accurately 
reflects reality-in this case the patient's state of health. In the absence of temporal 
reasoning, medical expert systems focus on scoring hyjnrthesesba^ on the findings 
that match events in the hypotheses and those unaccounted for in the hypotheses. 
TUP, in addition, enables an evaluation of temporal consistency of each hypothesis 
with the patient data every time the evahurtk»-duTerentiation-information loop is 
performed. 



the range relation is devoid of probabilistic information, the global 
constraint index of each hypothesis context cannot be also used by a rank scor- 
ing function. That one patient model should have a more constrained hypothesis 
context than another does not ne cessargy signify a better fit of patient data to hy- 

"la erwft ordcra*. dowtioe or poaUioa with tmptd to th« pnamt. 
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pothesized pathophysiology. Therefore, other than the consistency check, temporal 
information, as it is represented in TUP provides tittle help in calculating a rank 
of a hypothesis. Note this does not prevent ranking the hypothesis on atemporal 
features, as other AIM programs have done. 

Information Gathering 

Temporal "common sense" in information gathering is important. A medical expert 
system does not inspire confidence when it requests information obtainable only in 
the distant future. Nor does it make sense for such a system to repeatedly check 
for the presence of an event that (to a human) is definitely in the past. THRIPHT 
has the potential to avoid this sort of blunder because the hypothesis contexts 
of the patient models are almost always anchored to the present. Consequently, 
when some datum is to be obtained to distinguish one patient model form another, 
THRIPHT can determine whether the information about the corresponding event is 
in the past, straddles the present or is in the future. By judicious use of a few 
heuristics, this knowledge can cause THRIPHT to exhibit temporal "common sense" 
in its information seeking behavior. For example: 

• Do not consider (not just defer) seeking information about events more distant 
than m seconds in the future. 

• Defer seeking information about events more distant than n but closer than 
m seconds in the future. 

• If an event has a temporal relation to the present that has a lower bound that 
places the event in the past and an upper bound that places it in the future, 
be persistent about seeking information about this event. 

• Do not aggressively and repetitively seek information about past events that 
are reported to be unknown. 

In diagnosing a jaundiced neonate, THRIPHT could then ask if the serum bilirubin 
had fallen but would not ask if the patient's liver had yet attained adult function. 

3.5.2 Differentiating Between Patient Models 

The differences found between patient models drives the diagnostic process in this 
phase. These differences determine which patient data would be most effective in 
further separating the scores of the patient models in the differential diagnosis. 
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TUP', temporal representation enables THRIPHT to distinguish between hypothe- 
ses that diner in the order of events. For instance, the (traumatic) limb amputation 
that leads to infection and the infection that leads to (therapeutic) limb amputa- 
tion. Distinction, made between hypotheses that show the same ordering of events 
but w,th quantitatively different temporal distribution are al*> frequently ireful 
In neonatal jaundice, if the neonate ha. hmut milk fcumhce, the serum bilirubin 
IP**** ■responsible for jaundice) concentration rk« progressively from the fourth 
day of hfe and reaches a maximum by 15 days of life. Jaundice due to maternal- 
infant Rh incompatibility is clinically manifest in the first day of life. Physiologic 
joundtce occurs after the first day of Hfc ** mda witUn m week of birth (in the full 
term infant). Temporal representations such as TUP', can capture these difference, 
in clinkal course and export systems such as THRIPHT can locate them, thereby 
improving diagnostic acuity. 

3.6 Annotated Example 

h the preceding discussion, I have described the mechanisms of operation of the 
mdividual pieces of the diagnostic engine. In contrast, the example below is meant 
to provide a feel for how these various pieces fit together in the process of diagnosing 
a patient. ^^ • 

This annotated transcript describes user entries and THRIPHT's response. Since, 
during the course of my research, I purposely did not touch upon the issue, of tem- 
poral expression in natural language, THRIPHT lacks a "user-friendly" interface. 
Therefore, the English rendering I have given of the dialog with THRIPHT, corre- 
sponds to Lisp-forms intelligible to TUP and THRIPHT. Where appropriate, I show 
the forms used and diagram some of the structures generated by THRIPHT. 

The example is a fictitious episode in which a patient's history is taken at 8 
a.m., Jury 5th IMS. hems from the patient history are rendered in a «mis serif type 
style, THRIPHT's rehouses in bold type style and my comments in fteftcs. 



Beginning «/ «*« data-gathering phase 

0. The patient was 45 years old on July 1st. 1986. 

Equivaltntly: 

(RREL (CREF8Y8F0MI "45 YEARS OLD") 
(REF5T8 AGE) 
(TYPE P0MTT)) 
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((REFSYSFORM "00:01 a.«. , July l, t , 1986") 

(REFSYS CALEMDAR) 7 ' 

(TYPE POINT)) 
(0 SECONDS) (0 SECONDS)) 

This assertion permits TUP to respond to queries about the patient's age now, or 
at any other time, and with respect to any other event. 

1. The patient received a blood transfusion 9 to 12 weeks ago 

EquivalenUy: 

(RelationToPreeeat ((NAME BLOOD-TRAISFUSIOI) 

/i T 2L5l G ? ,| - I,ITttv AL) ) 
(9 WEEKST(12 WEEKS)) 

The expansion of RelationToPreaent is given on page 84. The (DATE) form in 
the expansion would evaluate to the current date and time: "8 a.m., July 5th 1986' 

2. Onset of jaundice occurred 8 to 9 weeks after the transfusion. 
EquivalenUy: 

(RREL ((HAME BLOOD-TRANSFUSION) 
( S5£5 JAU1DICE) 
(8 WEEKS) (0 WEEKS)) 

3. The onset of jaundice was first manifest in the morning, between 8 and 10 o'clock 
on June 5th. 1986 

EquivalenUy: 

(RREL ((REFSYSFORM "8 a.a.. June 6th. 1986") 
(REFSYS CALEMDAR)) * ' 

,(TYPE POIIT)) 
((NAME JAUNDICE) 

frYPEBMII-IITERVAL)) 
(0 SECONDS) (2 HOURS)) 

Redundant data are proferred. 

4. Inconsistent temporal Information: statements 1., 2., and 3. are 
inconsistent. Please withdraw one or more of the statements before 
proceeding. 
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TUP detect* that the bounds are inconsistent. Statements 1. and 2. would have the 

C^r ttm,v " early * Jun€ **> ^ « ~"* " «*• *""«* (V«fr 5th, 

1986). This is inconsistent with statement 3. 

5 Statement 3. is incorrect, the onset of jaundice was first manifest at 8 o'clock in 
the morning, on June 28th. 1986 

The REEL of statement 3. is withdrawn and the new MEL is asserted with the 
result shown in Figure 3.2. n 

With this assertion the data-gathering phase ends, and the hypothesis evocation 
Phase begins. A paraphrase of THRIPHT's reason** is only given when a condition 
of a trigger is satisfied. 

6. As the onset of jaundice has occurred, THRIPHT is considering 
jaundice-associated syndromes. 

The Jopmost node in the THRIPHT 's trigger hierarchy, shown on page 78, has a 
SUFFICIEKT condition that is satisfied by the patient data: 

(BEFORE-MOW-P 

((MAKE JAOTDICE) 
(TYPE BEGIM-IETERVAL))) 

This condition brings up for consideration the nest most general nodes whose 
triggers assume that the patient history includes the onset of an episode of 
jaundice. This represents the effect of my decision that the isolated assertion of 
jaundice m the future (i.e. speculation) wilt not cause active consideration of 
jaundice-associated syndromes. 

7. As the ace of the patient is greater than one year THRIPHT is 
considering adult jaundice and has ruled out infant jaundice. 

The adult jaundice trigger has a SOFPICIEIT condition that is satisfied: 

(AMD 

(REEL (CREF8YSF0RM "1 year old") 
(REFSY8 AGE) 
JTYPE POIIT)) 
((»AME MReMT-POIMT) 

3 * ^ th *fT" lW**«i. far k.p*titk B, the pewmtend mteodactkm of the infection ~.nt i. 
"pretexted by IMOCULATICW rMW the* . ILOOD-TIAHSTOSIOM. The tnuf.no. eveat. «• con- 

ITS *£*"1? *" *"*** ™** AW«^ tto ^^^ mrtc ki» f codd b. done 
»utom»tic*lly, u the curat impkmmUtion, I hsw to provide the mbstatatioa. 



.■'#Ki_i?r:3m£'li 
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| <JAUNDICCl 



OCM1AM, 

juwurr. 



8:00 AM, 

Jinn 

3BTH.10M 



8:00X1*, 

JULYSTH, 

IMS 




Figure 3.2: The Patient History 
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(TYPE POIMT)) 

(S-BEFORE-IOV-P 

(CREFSTSrOHM "1 y«ar old") 
(REFSYS AGE) 
(TYPE POUT)))) 

The first assertion is made to intern the 1 y«»r old point so that TUP may then 
perform the constraint propagation that will link that age to the calendar. Recall 
that the assertions generated during THRJPHT queries are in the quory context and 
can easily he flushed. 

The infant jaundice trigger has a RULE-OUT condition that is identical to that of 
the SUFFICIEIT condition of adult jaundice save for the substitution of 
S-AFTER-MOW for 8-BEFORE-lO*. 

8. As the trensfus ion preceded the jaundice, THRIPHT is considering 
PAREITERALLY-BORRE VIRAL HEPATITIS. As time between the onset of 
jaundice end transfusion is greater than two weeks, THRIPHT is ruling 
out BLOOD-TYPE-IICOMPATIBILITY. 

The trigger for viral hepatitis caused kg parenteral inoculation with the virus has, 
as a sufficient condition, a check that the transfusion precedes jaundice. Although 
instances have been reported, hepatitis A infections infrequently occur as a result of 
parenteral inoculation; the fecal-oral route is more common. Nonetheless, just as I 
have omitted many hypotheses that should he considered, I have included hepatitis 
A for demonstration. 

The blood-typt incompatibility trigger has the following RULE-OUT condition: 
(BEFORE-BY-P 

H!i5 T^iSESJNJLilTO bkm-ihterval)) 

UVAME JAUIDICE) (TYPE BEGXB-XMTERVAL)) 
(2 WEEKS) (♦IIFIIITY)* *«■■»». jj 

Note that the above condition does not test the relation to the present since this 
has been done by the JAUWHCE-ASSOCIATEf 8YHDR0NE8 trigger. 

9. As the transfusion preceded the jaundice by more than two weeks 
and less than 130 days, THRIPHT is considering IOR-A. MOM-B HEPATITIS. 
As the transfusion preceded the jaundice by more than 80 days and less 
than 180 days, THR IPHT is considering HEPATITIS TYPE B. As the 

M By mum otlwr tkaa iafMtkm, m»Oy intruragcitkr or iatnwmooa injection. 
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transfusion preceded the jaundice by more than 45 days, THRIPHT has 
ruled-out HEPATITIS A. 

The three triggers have sufficient and rule-out conditions that test for the 
respective delays between the onset of jaundice and the transfusion. Observe that it 
is only the hypothesis of parenteratly inoculated hepatitis A that has been ruled out, 
not all etiologies of hepatitis A. If this example were to be complete, I would show 
how another hepatitis A hypothesis (with a different inoculation mechanism) was 
triggered through another path down the trigger hierarchy. 

As the hepatitis B and non~A,non-B hepatitis triggers are terminal nodes in the 
trigger hierarchy, the hypotheses associated with these triggers are evoked and the 
elaboration phase begins. u 

10. HEPATITIS TYPE B has been elaborated into three mutually exclusive 
subhypotheses. MOI-A. MOlt-B HEPATITIS has been elaborated into three 
mutually exclusive subhypotheses. 

As illustrated in figure *.1S (page 47), the hepatitis B hypothesis has three 
mutually contradictory courses. The first course Hi goes from acute disease to 
resolution In the second course H % the acute episode is followed by a period of 
smoldering disease— chronic active. The third pathophysiological pathway H x 
includes clinical resolution with the maintenance of a chrome carrier state. In 
fact, there are more than three alternate courses** but these are not modeled. 
Elaboration creates a separate class (as discussed on page 80) for each mutually 
exclusive hypothesis. The result is shown in Figure S.S. 
To those readers who are wondering whether the antibody (anti-HBs) to the 
hepatitis B surface antigen (HBsAg) should not be made mutually exclusive to the 
chronic active or chronic persistent courses, I point out that there are cases where 
the antibody has been detected in these chronic courses but only when the HBsAg 
antigen has not been detected fa}. TmUPHT's knowledge boot reflects this by 
asserting that the end of the period of detectable HBsAg precedes the beginning of 
the period of det e cta b l e anti*HBe. 



''Again, for d em oM t T etion parpoei, I have ignored kjr p o th uM which shodd be considered, even 
u the absence rf additional date. Aidqr«l««iwmfci,miyi«^«ri9 M ^eoMid«rtl W l V p^keM. 
of chemical hepatitis. 



"e-g. The chronic active state can, is torn* cases, progress to recovery or a chronic earner state 
and there ahw is a chronic pewit eat state. 
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Figure 3.3: The elaborated hypothesis for hepatitis B 
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Figure 3.4: Triggered hypothesis for aoa-A, non^B hepatitis 
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11. HOI-A. MOM-B VIRAL HEPATITIS bu been elaborated into three 
mutually exclusive subbypotheses. 

The non-A, non-B hepatitis hypothesis ha* a similar causal structure to hepatitis B 
(Figure S.4). At this level of detail, the only difference is that there are no antigens 
or antibodies. None are modeled as the presumed agent has not been identified. 

12. Now beginning instantiation of all subbypotheses... 

For each of the mutually exclusive subhypotkeses, THRIPHT creates a temporal 
context. The RREU are linked to event descriptions" and therefore RREU attached 
to mutually exclusive events are asserted in different contexts. For H lt the RREU 
associated with the events of the subhypothesis are listed in appendix B. 
Each point in each REEL is then given one or more reference set memberships 
which it shares with all events that share the same causal aggregate(s). THRIPHT 
then sends the RREU to TUP to be asserted and their constraints propagated. The 
result, for H x is shown in Figure S.5. Observe how SCH has taken the "chunking' 
pattern of the causal aggregation hierarchy of the H x hypothesis and translated it 
into reference sets. Clearly, the prodmrne/aeute-hepotitis reference set is the 
largest with five intervals (10 points). The immune response and viral replication 
reference sets would be of comparable size if I had modeled the many antigens and 
antibodies that are synthesized during an infection. 

Subsequently, temporal assertions of the patient history are added to each context 
and propagated. Note that since the events of the patient history are anchored with 
respect to the present, the events of the instantiated hypotheses become anchored as 
well. For instance, if the patient fits into B x population of patients with hepatitis 
B, the end of jaundice can be expected from two weeks before to 4 weeks after the 
present (the time when the history was taken). 

This process is executed for all subhypotheses. 
13. Now beginning hypothesis ranking... 

The implementation of the last diagnostic phase is incomplete. Nevertheless, 
given the instantiated hypotheses in this example, I will take the opportunity 
to demonstrate that even when atemporal differences between hypotheses can be 
found, they are often insufficient. 

M Am implemented, BUI* are added to a hypotaeei* by ruing * mooae to -button- an event in a 
graphical dfeplajr of ike cmmI graph and taw adding a TUP insertion to the temporal aaaertion alot 
of that event node in the graph. 
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Figure 3.5: Inatantiated Hypothesis Without Patient Hiatory 
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To determine whether the preient illness was non-A, non-B hepatitis or hepati- 
tis B it would be help THRIPHT to find out if and when HBsAG and/or anti-HBs 
had been detected. To an expert system, without TUP's capabilities at hand, cor- 
rectly posing the question and then interpreting the answer would be very difficult. 
Suppose both antigen and antibody had been detected. Whether this represented 
a bout of hepatitis B prior to the present illness or the resolution of the present 
illness would depend on the timing with respect to the present of these events. The 
HBsAg would have to be detected between one to two months after the transfusion 
and the anti-HBs would have to be detected alter the HBsAg. 

So, even when a finding is specific to one disease, the temporal dimension may 
be needed to interpret the finding's absence or 



4. Temporal Knowledge Base 
Engineering 



The capability for temporal reasoning significantly improve, an expert system's 
performance: the number of hypotheses considered decrease, dramatically (see 
page 74), diagnostic style becomes more human-like, and greater finesse is achieved 
in distinguishing between hypothecs. The cost of such an improvement is a much 
larger effort in knowledge baee engineering than required previously. Themajorpart 
of the effort arises not in the task of constructing the knowledge structures, but in 
obtaining the required temporal information. In this chapter, I point out some of 
the difficulties that a knowledge engineer will have in creating temporally-oriented 
knowledge bases. I abo discuss how I have dealt with these obstacles during my 
experience in using THRIPHT. To illustrate some of the technique, taed, I examine 
(in section 4.4) an excerpt from a medical text and proceed to identify the temporal 
information it contains. 

4.1 Implicit "Common Sense" 

It happens, not infrequently, that a neophyte knowledge engineer will set out to 
represent a body of expertise, expecting that the domain knowledge will be found 
in some documents used by the domain expert or used to tram domain experts. 
What she soon discovers, especially if the *«dkH^ k broad and realistic, is that 
a large fraction of the knowledge needed to make the expert system emulate the 
expert's behavior is not to be found in any document. Nor will it be elaborated by 
the expert at least during the first few attempts at debriefing, or protocol analysis. 

4.1.1 "Common Sense" Temporal Knowledge 

One of the reason* for this phenomenon is that there is a lot of -expert's knowledge, 
that is routinely needed for survival in the world, so commonplace that we are rarely 
conscious of our use of it. That an object should continue to exist even when it is not 
perceptible to our senses, that there is a distinction between internal (intrapsychic) 
events and event* external to the individual are not inherently obvious concepts to 
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an expert system or to a new-born child. To fail to acquire such knowledge of the 
world fa to fundamentally handicap performance. Due to it. almoet universal use 
such expertise fa known ai "common sense." A large body of temporal knowledge 
is common sense and fa therefore difficult to identify and formalise. 

In medicine, in addition to the common sense knowledge that most people share, 
there is the bask medical knowledge that fa acquired early m medical school edu- 
cation and upon which further knowledge acquisition depends. In the professional 
literature, the basic concepts are usually left implicit and therefore require that the 
reader be sufficiently trained to understand the explicit information. There is no 
surprise, then, if an expert system solely built from the information in a medical 
reference book should fall to simulate a l*ysiciwi». performance. This fa also true 
of the temporal component of medical knowledge. 

In a compendium of the infectious diseases, the duration of the incubation pe- 
riod and the duration of the prodrome might be documented with the implicit 
understanding that the onset of the incubation period precedes the onset of the 
disease prodrome. Similarly, in a discussion of the possible cliiiical courses of my- 
ocardial infarction, the apparently obvious temi*^ relationships between fachemia 
and hypoxemia may be omitted. 

The pervasiveness and volume of this implicit information means that for ev- 
ery temporal relationship obtained from t* *mam expert «*r domam documenta- 
tion the knowledge engineer has to consider what s^itioiial ten^ral nUationship. 
might be taken for granted and how such information fa to be obtained. 

4.2 Adherence to TUP Semantics 

In chapter 2, I explained how strkt adherence to TUP semantics was necessary if 
TUP', inferences were to be at all meaningful. I discuss here a few of the circum- 
stances in which a knowledge engineer might be led into distorting these semantics. 

4.2.1 RREL Bounds 

Greater constraint of the temporal context in a medical knowledge base permits 
more acute differentiation between hypotheses, m ti» construction of a knowledge 
base, it fa therefore generally desirable to assert RULs with bounds that are as 
constrained as possible. It fa important however, not to do so in contravention of 
the RREL bound semantics. For instance, one can find in a medical text book that: 
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Treatment [of HaemophUu* ducreyi infection] with tetracycline, or sul- 
fonamides often results in heeling in 2 weeks [24, page 215]. 

The temptation is to construct an RREL a. in example 22 with an upper bound 
oftwo weeks. Recall however that RREL bound, are the limit, on the separation 
between event, within a hypothesis. If the bound, of temporal relation, that are 
often observed are asserted in TUP, all consequent temporal inference, no longer 
have the expected meaning. It then becomes impossible to know what to make of 
an inconsistency or in fact any temporal inference. 

Example 22 

Even if probabilistic information could be encoded in RRELs it is not clear how 
«us notion of "often" would be encoded. Inrfead, the knowledge engineer must 
determine what the extreme value, are for each of the bounds, in this case the max- 
unum delay ^between onset of treatment and clinical cure. If these extreme value, 
cannot be obtained, and no safe estimate can be made, the knowledge engineer may 
haveto be satisfied with jurt encoding the precedence information (a lower bound 
of ♦EPSILOir and an upper bound of TiTIim). This precedence informatXon alone 
will go a long way in helping to dirtingukh hypotheses. Also, as explained in chap- 
ter 2, other constraint, such a. life^an will cause all events with infinite bounds to 
be con.iderably constrained after constraint propagation. As a result, instantiated 
hypothe*»-.patient models-^o not contain assertions that the patient will heal in 
infinite time. 

4.2.2 Loose Bounds and Alternate Contexts 

TUP provides two ways of reprssenting uncertain temporal knowledge. One way is 
to assert a range within which the temporal relation must lie. The other way is 
to assert several RRELs, one in each context to represent several different possible 
ranges. Although it is not always dear-cut, there are some reliable guidelines by 
which one can deci de which method to use. 

1 Thi. mi, ht U MtinU oaly from » ntker Uatekw pmpMtiv*. 
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Setting bound* of a temporal relation i* equivalent to asserting that no sub- 
population of individuals can be identified within the larger population about which 
more precise (or constrained) assertions could be made. If, however, such distinct 
subpopulations are identified or at least known to exist, then the bounds particular 
to each sub-population can be asserted in RSELs in alternate contexts. For example, 
the delay between the onset of clinical hepatitis and the inoculation with virus, 
might be some function of the host's immune system activity, nutritional status 
and numerous other constitutional factors. Until medical science discovers what 
this function is, or identifies populations of patient with different incubation times, 
all that can be said of the delay is that it is bounded by 50 to 180 days. The state 
of knowledge is different for the duration of detectable serum Hepatitis B Surface 
Antigen (HBsAg). Here, several distinct populations are known to exist and have 
been identified. In the population of patients whose disease fully resolves, HBsAg 
disappears approximately within a year of viral exposure. In those unfortunate 
enough to develop chronic-active hepatitis, the HBsAg levels may persist for several 
years. It is appropriate in this case to assert an MIL for the duration of HBsAg in 
each population, each in its respective context. 9 

Subpopulations of Temporal Percentiles 

Contexts permit a limited representation of the a priori probabilities of bounds on 
RRELs. They are of some use in those few occasions when systematic population- 
wide studies have been made of the temporal progression of events in life and disease. 
The Denver Developmental Screening Test (DDST) [18] is one such study. 

The DDST is designed to provide the pediatrician with a set of landmarks that 
will permit the evaluation of the developmental progress of the child. The DDST 
provides, for each behavior, the time by which 25%, 50%, 75% and 90% of the 
population will have a reached the stage at which the behavior can be observed. 
This information could be represented in THMPHT by having a separate context for 
each distinct percentile. There would then be a hypothesis for children falling in 
the first quartile, second quartile, third quartile and so on. If a child was found to 
begin to say -mama" or "dada* after 8} months, the percentile knowledge would 
enable THRIPHT to determine that for that particular test of language, the child 
was in the slowest quartile. 



a lf tk» i. not dear, coaakUr that oac* a dktiact wb-popuUtioa k id«tiS*d, it U a n«w hypothec 
unto itMlf and thovfan nqvhm its own patiant modtl ud a«odat«l temporal coataxt. 
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4.3 Volume of Relevant Information 

After just a brief experience with temporal knowledge engineering, it become, clear 
that for every event/state in the atemporal knowledge bate, there are very many 
temporal relations that have to be encoded. One of the reasons for this is that the 
global constraint index of a THWPHT hypothesis ha. to be quite low to simulate the 
temporal precision with which human beings distinguish between differing disease 
chronologies. Usually, individual BRELs (before constraint propagation) have rela- 
tively high constraint indexes, so that in practice the way to achieve a low global 
constraint index is to assert several MELs between each event and the other events 
in the hypotheses so that there is a greater chance of loop creation and consequent 
constraint propagation.* 

Although intuition is often sufficient to determine whether the event positions in 
a disease chronology have been sufficiently constrained, in practice the knowledge 
engineer may be misled by common sense knowledge 4 and overtook some relations 
that would significantly reduce the global constraint index. I have found in the 
development of the THWPHT knowledge bases thatbitbesttoussTUPasan 
interactive tool to determine if an adequate number of sufficiently constrained tern- 
poral relations have been entered. TUP can demonstrate loop creation, measure 
the global constraint index and verify whether the assertions have produced the 
expected ordering of events in the hypothesis. 

4.4 Example 

The example I have chosen to illustrate some of the techniques in temporal knowl- 
edge acquisition hss been taken verbatim from a widely need textbook of medicine 
(22). It is part of the description of the clinical manifestations of pinte— a skin 
infection with a chronic course. The only modification of the textbook material is 
the use of bold-face, italic fonts and underlining to identify different types of tem- 
poral information. Underlining highlights events, italics denote temporal cues and 
boldface indicates alternate contexts. 

The incubation period in experimental pint* is 7 to Ml day. In man, 
the initial nunifaftatmn is a small papule developing by extension or 

3 Tkat u, th« wofimnlwuk r on rt ra h rt* en nbeUtete far fewer ctnag co&etnuU. 
Vg. She may Uk* for traated that vinu iacabasioa follow. th« uwxndmtion. 
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by g^l«Wntq With Mtel l to l«JOM into a scaly maculopapular lesion. 
Thcre b "«ion>J lymp hadenopathy . A generalised erythrosquamous 
zaah develop* three to nine months after infection and can be of the 
"wandering* type... One to three years after the initial lesion, sitabje. 
dyschromic mj£ujes. develop. These io*« jejjons devefop from secondary 
Ptotides orindependently, and jmm from sJUe_bJss tArou** violet to 
bjgwn and ghj|e— the firm/ achromk phase of the pathogenic process . 

This is the clinical course of the population of individuals suffering from pinta. 
This corresponds to THRIPHT's compo.it* hypotheses. Since only instantiated 
hypotheses— patient modebt-contain events that actually happen to a specific in- 
dividual, only a patient model can contain temporal relations with respect to the 
present. Consequently, in the above excerpt, there are no references to the present. 

At first, the natural language equivalent, to the events and temporal relations of 
TUP might be surprising. In TUP's representation, an event is any interval or point 
in time that is identifiable or distinguished in some way from contiguous temporal 

points or intervals. In thi. ««n~ ^frifflwt Tilth ■«**»*- 'tlinni ; " --, 

event as the mcubation_period. Sometimes the relereacei to events are eUiptical; in 
the example, the color sJifte_bjue. is an ellipsis for "the period during which there 
are slate blue skin lesions.- Care ha. to be taken to ensure that paraphrase, of an 
event (e.g. late ksjojtf and liable dyachromk macules) be either translated into 
the same canonical event in TUP or that the patai»hra^ events be made temporally 
equivalent. 8 The temporal cues are also not those one usually associates with the 
specification of temporal position; nonetheless, initial, final a. well as the verbs pass 
and develops communicate much of the temporal information in the example. 

It is apparent that the author of the text quoted above ha* made some (reason- 
able) assumption, about the medical knowledge of the reader. The assumptions, 
however, leave gaps in the temporal knowledge base that the unwary knowledge 
engineer may miss or have difficulty with. For instance there is in the example the 
statement that There is regional lymphadenopathy ." To locate this event's tempo- 
ral position in the knowledge bas e requires additional (assumed) knowledge—that 

6 Ewu Aoefk this is usually the cw, it k ao* strictly tree. A population hypothens could 
d«wio« tk« rtUtioa between a clinical syndrome aad a .pecific date (e. f . the hit* incidence of 
Parhnoaka after the 1918 outbreak of mlueasa.) and TOP would compute the position of all 
events in the hypothesis with respect to the present. 

•i.t., If the mnU mr« intervals, USX. art asserted that make the onset and end of tke paraphrases 
simultaneous. 
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^phad^op.^ wiU folkm onset of infection. More than general medical knowl- 
edge ib needed to further constrain the temporal portion of the lymphadenopathy 
but perhaps further constraint is unnecessary for the diagnostic task.' 

4.5 Finding Reference Sets 

We can identify several causal aggregate, to represent in a THRIPHT knowledge 
base and which TUPcould then u* to drive the generation of rrference sets. At th. 
top-most level, there is pinta whkh is an aggregate of all the pebble pathophys- 
iological course, of the dk^. A level down, there are the major segregates* 
infection, generahsed secondary (erythrowmamou.) rash and the lat-letion ph-e. 
We can go yet further and resolve the (acute and initial) hifection aggregate into its 

"T?? f". inCub ^ 0tt »«". *• **«** PI**, the extension or coalescence 
with satellite k«o». and the scaly maculopapular lerion. A similar decomposition 
can be made for the other aggregates. 

ff *edbmam-d«p^to^ 
sets, reflect, a natural decomposition, then the reference seto will have the property 
of usuall, -conUinmg the more froa^ently r«ri^ temporal relatfcn. betw^ 
closely interrelated events of that domain. 

In this example, the more constrained relations tend to occur between events 
sharing the same reference .«. In feet, in the exam**, event, that share reference 
set. are tiwoaly one. with quantitative temporal relation. (U numerical bound.) 
and are ^therefore more conrfrained titan the qiiaHtativ^ ord^ temporal relation, 
of event, m separate reference sets. Specifically, the onset and end of incubation 
-hare the same reference set: infection; the moadary raA and infection also share 
the same reference set: Pinta; the late lesions and the infection abo Aare the PinU 
reference set.* 



fic-nOy dirtfect feet th* i**** fc otl-r j^^ ^ ^ ***** t^.*^ 
"Note hewtvir tast mtkm 



nlatod to tfe I.* k.b.1. l^Mm^mtA^tkmwttMxct^nkiUutidtwmiJi/aiMm^^ZZ 



~™ ™ „ ,„. w M qraoeraos*. ItartkenMK, is MSfssM to tat nktioa b«tww& th. 
tl W Sd^Cl«t«i M Hm^k»oti*y^ 
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Presumably, the purpose of a medical text is to sufficiently inform the clinician so 
that he will have at least the minimum information required to make a diagnosis. In 
this light, the fact that moat temporal relations in the example are of the qualitative 
ordering variety telk us that even relatively unconstrained temporal relations are 
sufficient for much of the diagnostic task. Only those few relations that are critical 
in differentiating one disease from other are given numerical bounds. Note that 
most of the temporal qualifiers in this example only specify the ordering of the 
onset of intervals, rather than the relative position of interval endings. This may 
be because the latter ordering provides less diagnostic information. 9 

4.6 Growth in the Number of Contexts 

The bold-faced items in the example mark branches into alternate subhypotheses 
and associated temporal contexts. At every such branch, the number of possible 
contexts doubles. In the example, there are three branch points and, therefore, 
eight contexts are required to represent the temporal relations of all the possible 
pathophysiological progressions. 

Large hypotheses, such as I have developed for diseases like hepatitis B, will 
obviously generate a very large number of contexts. For this reason, if real-time 
performance is expected of the expert system, then the more likely subhypotheses 
(and associated temporal contexts) would have to be heuristically selected. 

4.7 Summary 

The purposes for which this chapter was written include guidance and forewarning 
in negotiating some of the difficulties of temporally sophisticated knowledge engi- 
neering. I end the chapter by emphasising the forewarning. The example I have 
used here is one small part of the available knowledge of a relatively uncomplicated 
disease course. Full-fledged hypotheses, such as are required to diagnose diseases on 
the order of the hepatitides or ischemic heart disease, are major endeavors requiring 
at least double the effort of their atemporal versions. This effort arises not in the 



up. 



»Mo* probably Ucum th« duration «ad th««for. Midi** of tht vuiow intwvd* i. much more 
vwUbk, and thwrfbn Urn .pacific, tkaa taw on**. 
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entry of such knowledge but in identifying and acquiring the knowledge. The payoff, 
of course, is quantitatively and qualitatively improved diagnostic performance. 



5. Time In Human Cognition 



Well into completing my work on TUP and THREPHT, I became curious a> to what 
was known about the cognitive me chani sm s that human beings might employ for 
temporal reasoning. My interest was quite specific: I wished to see to what extent 
the fundamental computational limitations of temporal reasoning that I had been 
faced with in TUP's development (e.g. the explosion of the number of possible 
temporal deductions) and the solutions I had found, (e.g. reference sets) had their 
analogies in the human cognitive process. This is not to say that I had a literal- 
minded expectation of an electrochemical equivalent of the RREL subject to waves of 
constraint propagation spreading through neuronal networks. I was instead looking 
for the manifestations of the generic problems associated with temporal reasoning. 
There has been a significant effort made in cognitive science in the area of 
temporal reasoning and representation. Much of it is contested even within the 
discipline. For instance, in attempting to define the attributes of information that 
give us our notions of time, several hypotheses have been proposed with varying 
degrees of success and amounts of supporting experimental evidence. Among these: 
the amount of memory storage space occupied by an interval of time (44] , the effort 
required to retrieve the event [5] or the intrinsic order of the events represented [39]. 

5.1 Extent of Temporal Computation 

To obtain the temporal position of one event relative to another, all event relations 
that are stored can potentially serve to derive this information. Only a few of 
these relations will provide the most precise estimate of temporal position or one 
sufficiently precise to be useful. To find these few useful temporal relations, a large 
computational investment has to be made. This investment can be made when the 
temporal data is first accumulated (as in constraint propagation), upon retrieval 
(as in search) or both (as implemented in TUP). Erickson [15] postulates that 
in the process of responding to a temporal query, there are distinct subprocesses: 
retrieving information from memory, coding order information and comparing the 
retrieved order information with that in the query. Blankenship [3] argues that 
"encoding information in long-term memory does not automatically incorporate 

107 
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information about when the storage 1 took place." Order judgments may have to 
be inferred using various context-dependent sequence rides. Mkhon and Jackson 
[39] point out that there are several cues associated with events that permit the 
retrieval of order such as causal antecedent/consequent relationships. 

Regardless of when and how this computational investment occurs, it grows 
rapidly with the amount of temporal information (number of events) stored. The 
critical quantity of information beyond whkh the computational burden becomes 
unacceptable depends on the reasoning mechanisms, the representation of temporal 
information and the performance expected. I feel safe in hypothesising that this 
critical quantity is less than the total amount of temporal information stored in 
the human memory. That is, it would be extremely surprising if the temporal 
information regarding all events stored in the brain were used to determine the 
relative position of two particular events. 

A survey of the cognitive science literature reveals strong evidence that sup- 
ports the notion of local temporal reasoning contained within "chunked" groups 
of events. One line of evidence involves the relatively recent work on cognitive 
streaming. When the human information processor has to simultaneously handle 
an overwhelming amount of information, the information is split into several infor- 
mation patterns— cognitive streams. Attention is rapidly switched between streams 
to maintain an illusion of "reel-time" continuity. Bregmas [©) in his seminal work 
on auditory streams provides strong support for the hypothesis that streaming oc- 
curs in the auditory process. Among the factors that determine to which of the 
streams auditory events are added, Bregman describes similarity of spectral com- 
position. Moreover, he finds significant differences in the strength and accuracy of 
the perception of ordering of auditory events in different streams as compared to 
events in the same stream. That is, the accuracy of the perception of ordering is 
more accurate between events that are more closely related. 

Michon and Jackson [SO] have further investigated cognitive streams and the 
recall of temporal ordering information as it is affected by event (word) catego- 
rization. In their experiments an attempt was made to induce cognitive stream- 
ing by presenting the subjects with large numbers of .rents in a relatively short 
period. Of particular interest, the experimental evidence seems to demonstrate 
that the separation of events into cognitive streams does in fact happen, but only 
if the events are closely related (what Michon and Jackson refer to as meaning- 

^Mweatwip^riwwdbytktMbj^iiiiiwWsM. la BUaJMueip's experimeat., tke eveats 
were jigsaw punk tasks. 
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/«Me*,) which in tW experiment., .igniue. shared word category membership. 
Significantly, between-category ordering judgment, are correct lea. frequently than 
within-category ordering judgment.. In a .imiUr vein, Blankenship's [3, page 40] 
experiment, .how that pair order judgment, are much more accurate, and arrived 
at much farter, if the event pairs have a "context.** 

Although I cannot go any further than noting the analogy, it is at the very 
least mtngumg that TUP', solution for managing the temporal relation, between 
large number of event, is to group event, together in reference set.. Temporal 
relation, between event, in different reference a*, are not guaranty to be consta- 
tent and .furthermore the Performance gain. «q ? ectrf from rrfsrence ^to are only 
accrued J the member, of reference set. .hare me organtaing feature or ^lience-- 
mearunffulness or "context." 

One of the reasons to be careful in pushing the analogy any further than I 
have already i. that the human performance in temporal reaeoning may be just a 
epiphenomenon of the more general elect, of "chwiJriitf observed m the memory 
■torage process.* For example, Patterns, W*m and Mandkr [47] have .hown 
that shorter interresponee time. (IRTs) occur between item, in the Mine "chunk" 
than between item, in different chunk.. The growth of the duration in between- 

Polho, Richard, and Lucas [49] and Pattern et «/. [47] for inetance have devel- 
oped a probabilistic March model to account for tl^ ob^rved exponential growth 
of between-group IRT. with output portion, whereas McCauky and Kella. [35] 
ob^rve a linear growth. It i. becanae of theae parallel, between the performance 
characterirtic. of the., general retrieval operation, and thoa. of temporal rocall that 
it is diificult to isolate the effect, of the human temporal reasoning mechani.ms. 






b. it TRUraT'. e««d ki«re*y, • KL-OK. cb-Mk*k» M-m^ « . ,d««^. god trJT^ 
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5.2 Constraint from Background Temporal Infor- 
mation 

When THRIPHT instantiates a hypothesis so that it becomes a patient model, the 
temporal relations in the patient history may constrain those of the pathophysiolog- 
ical hypothesis and vice versa. This process represents a mapping of certain events 
in the pathophysiological hypothesis to reported events in the patient history. If 
the mapping is a correct one, then the temporal information from these two sources 
may make reciprocal contribution, to the knowledge of ordering/position of events 
from each source. If a patient reports malaise and fever after a blood transfusion 
(without stating how much earlier the transfusion occurred), if non-A, non-B hep- 
atitis is one of the hypotheses considered, then the period 4 between malaise and 
transfusion can be bounded between forty-five and sixty days. Most generally, if 
TUP is given two different temporal sets of REEL's, and then a few events from one 
set are temporally associated to events in the other set, very often the relations of 
both sets of REEL'S will be constrained if they are asserted in the same context. 

A parallel phenomenon may have been observed in human subjects by Guenter 
and Linton [21J. Subjects were shown sequences of unrelated pictures and then asked 
to recall the temporal location of these pictures. If a recorded short story that bore 
no relation to the pictures was provided simultaneously with the projection of the 
pictures, temporal performance was improved. Guenter and Linton view the story 
as having provided temporal toss for the pictures. My view, which is consistent 
with Guenter and Linton's interpretation, is that the set of story phrases had more 
constrained* temporal relationships to one another than the pictures had between 
each other. Consequently, the story line could constrain the temporal relationships 
of the pictures, analogous to the manner in which the findings obtained from a 
patient with hepatitis, constrains the temporal relations of the hepatitis hypothesis. 

5.3 Relative Performance of Retrieval Tasks 

Of all the temporal retrieval operations that TUP can perform, the one that requires 
the least computational resources is the determination of the position of one point 

4 Only within that hypotheafc. 

•Since the phraeea were related to one another w part of a atory line unlike the picture, that 
were unrelated to one another. 
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in time relative to another. If the two points are in the tame reference set, ail that is 
required is a direct retrieval of the one RREL that links the two points. If the points 
are in different reference sets, a search is performed. The qualitative* equivalent of 
the operation is known in the cognitive science literature as an order judgment. 

The determination of which set of events occur between two time points is 
performed by the TUP FIIDBETWEEI function; the cognitive science equivalent is a 
lot judgment. This function is considerably more expensive (for TUP) than range 
relation retrieval as it involves determining the position of each of the events with 
respect to the two time points. 

An event's ordinal position in a set of events can be obtained using TUP's 
FIirDPOgiTIOI--a bo know n as a petition judgment. It has about one and a half of 
the cost of a PIMDBETWEEJI computation, as described in section 2.7.2. 

This ranking of computational effort is neiAer inevitable nor necessary. If events 
were represented by specifying, for each event, a list of those events that occurred 
before it and those that occurred after it, then position judgment would require the 
least effort (just counting how many events preceded a particular point in time). 
Order would be next in computational expe ns e t he point with the shorter "before" 
list would be the earlier point. Lag would be most expensive (intersection of the 
"after" list of the earlier point with the "before" list of the later point) . 

In the development of TUP the choke of temporal relationship for the primary 
underlying representation, was determined by what I perceived to be the kind of 
temporal information available (in the medical literature) and by the kind that was 
most important and most frequently used in making temporal distinctions between 
(medical) hypotheses. 

Experimental evidence points to the similarity in the ordering of difficulty of 
these tasks in human beings to that in TUP. The work of Jackson and Michon [23], 
for instance, shows ordering judgments to be less difficult than position and lag 
judgments. Lag judgments also appear to require less time than position judgments. 

Although tekeJogkal arguments are not very helpful in supporting hypotheses, 
the coherence they provide is nonetheless satisfying. In this spirit, one could hypoth- 
esise that the m e ch an ism s developed through the biological, evolutionary process 
would select those cognitive mechanisms that piwiuce the best performance for the 
kind of temporal reasoning that man most frequently performs. It might be then 
that recognising the ordering of event pairs k much more frequently necessary than 

"Qnalitatto only t*at Um ordering bat not tampon! distance ia mewured. 
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are lag judgments in going about the business of survival. 

5.4 Summary 

Artificial intelligence and cognitive science are sister disciplines. Although the 
methodology and some of the goals may differ, there is a shared interest in the 
mechanisms of cognition. However it is only in a limited number of areas, such 
as vision, that the common interest has produced some synergistic interactions 
with interesting results. My own brief survey of the literature of cognitive science 
suggests that temporal reasoning is another area that may be ripe for the multidis- 
ciphnary approach. In this chapter I touched upon analogies in the performance of 
TUP and human beings. How this analogy in performance bears on similarities in 
representation or reasoning mechanisms is not at all apparent, but suggests further 
investigations to be pursued in this area. 
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6. Conclusion 



6.1 The Problem 



Very early m my study of automated diagnostic systems and in particular medical 
expert systems, it became rather obvious that a crucial component of the diag- 
nostic armamentarium-disease chronology-was not accessible using the available 
knowledge-engineering tools. As diseases are not statk collection* of signs, symp- 
toms and pathophysiological states, but dynamic processes with specific temporal 
patterns, such a deficiency appeared to be a fundamental obstacle to achieving 
human-like style and human-like performance. 

Without access to temporal infarnurtion about the patient 
edge of disease, expert systems consider hypotheses that account for the findings 
but not in the particular order or temiK^ configuration observed. Prom the per- 
spective of the human expert such an expert system asks questions that have no 
apparent bearing on the patient's condition. This reflects that, in the absence 
of temporal information, many hypotheses are pursued that would be otherwise 
quickly dismissed by a human expert, or temporally sophisticated expert system. 
Even if the atemporal discrepancies between the patient data and the expert sys- 
tems hypotheses eventually become gross enough to permit the exclusion of the 
incorrect hypotheses, too many questions are asked and too much computational 
resources are expended in doing so. 

Unnecessary generation of questions during an expert system's performance is 
intrinsically undesirable. Many questions may require diagnostic procedures that 
have their own cost--discomfort, morbidity, mortality and financial. Also, an expert 
system that asks too many questions, most of which may seem unrelated to the 
patient's problem will be unacceptable to the health-care provider because of the 
attention the system would demand and because such performance would engender 
alackofconfic^ncemthediaiiiostfccoachirions. Temporal knowledge by no means 
eliminates all superfluous questions, but it does prune a large proportion of these. 

Lack of temporal representation also implies a lack of a principled distinction 
between past, present and future. For the diagnostic program, this again leads to the 
generation of obviously unanswerable questions, for instance regarding the distant 
future. It also excludes the possibility of a temporally quantified prognosis. For the 
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medical expert system which plans therapeutic interventions, lack of knowledge of 
the position of events with respect to the present will lead to absurdities such as 
making plans to modify the past. 

The crux of expert system technology is the explicit representation of all the 
knowledge that a human expert uses to perform. It is not surprising that in the 
absence of an explicit representation of an aspect of human reasoning as ubiquitous 
as temporal reasoning, the expert system should fail to consistently model expert 
performance. This failure is not restricted to diagnostic and planning performance, 
but extends to justification, explanation and outcome representation. 

6.2 The Plan 

In the current literature of knowledge-based systems, there is an almost ritualistic 
paying of obeisance to the merit of temporal representation or the problems that 
arise in its absence. In most cases, this is the extent of the concern with the 
issue. Frequently, tin ad hoc solution will be described that works for a particular 
application for most of the test cases. On the other end of the spectrum, a number of 
coherent and principled temporal logics have been devised that usually provide little 
guidance or assurance about the use of such systems in implementing the necessary 
functionality (in AI systems that deal with real-world situations). The design and 
implementation of TUP and THRIPHT was aimed at providing and demonstrating 
this functionality without sacrificing generality. 

While I developed the tools that would enable expert systems to perform tem- 
poral reasoning, three major issues became apparent. The first is the task of sup- 
porting the heterogeneity of temporal expression needed for real-world applications. 
My intent was to do so with a small number of temporal primitives, manipulated by 
a few temporal operators. Parsimony and simplicity in the underlying representa- 
tion was emphasised because of the need for a well-understood, uniform method to 
determine the combination of temporal assertions that produced the most precise 
estimate of temporal location. The same simplicity would also permit temporal 
consistency to be readily determined. 

The second issue or problem manifested itself in TUP's initial trials. It was 
apparent that the number of temporal deductions made in realistic applications 
made temporal reasoning pragmatically infeatible. The obvious solution was to 
divide the temporal knowledge base into smaller, manageable pieces. The real 
challenge lay in devising a method for temporal clustering what would minimise 
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the Iom of precision and consistency in the relations retrieved without requiring a 
large investment of effort on the part of the knowledge engineer. 

The last of the three issues and initially the most challenging one, was the inte- 
ntion of temporal reasoning into a m^ It had to be determined 
if temporal reasoning could be divorced from the other faiferencm performed in an 
expert system. One of the themes that recur, in expert systems is that successful 
eystem development depende on dear distinction, between the different types of 
knowledge. Thus, in rule-based systems, the operations of the inference engine are 
encoded independently 1 and are distinct from tile A«nam bwwledge. For the same 
re-ons, it was apparent that temporal reasoning wonM have to be independent and 
autonomous from other expert system operations. Such autonomy necessitated the 
triage of the generk knowledge types in an expert system into two categories: atem- 
poral and temporal.* A skeletal second generation ejn?ert system-THWPH^-had 
to be developed to investigate the way in whkh an wrtoimmous temporal reasoner 
could interact with the afmporal inference mnduMnssa. of such an exi**t system. 

6.3 The Outcome 

Once the attempt was made, it was surprising just how dear a distinction there 
was between the temporal and atemporal slsmsnfa of the knowledge bases of expert 
systems. This tem|ml*temporal dichotomy was ao sharp that it was possible to 
maintain an independent temporal hyp4^^sls (context) paired with each atemporal 
domain hypothesis represented. This distinction Htanrinatm some of the previous ef- 
forts mknowledge-basedsystems. For example, in Binger and Grinberg's (51] causal 
representation for their "Common^ne. Aajssisiis^ sever* differ 
identified. Many of the relatione worn farther catsgorlnid by the temporal relation- 
ehip, which could be of two types (one shot or continuous). One causal relation was 
defined as follows: 

Action A, or tendency T causes state S, or state change SC to exist, 
providing gating conditions Sl,...,Sn are in offset. For the continuous 
form, the action's continued presence is required to sustain the state or 



1 WW it do« sot, •amp.cUd istmctfass •mi *»• «m« «r«tu»ll y « minify. 
(m* Mctua 8.4). 
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statechange... For the one shot form, AorTii required only momen- 
tarily. 

Ignoring the gating conditions 8 THRIPHT could model a continuous causal link 
with a vanilla THRIPHT causal-link and the following constraints: 

(+EPSILON) (♦INFINITY)) 

(RREL MMil inns h5- imterval ^ 

(0 SECOMDS) SEC01DS)) 

Similarly, a one shot causal link would be modeled with these temporal constraints: 4 

(RREL ((NAME A) (TYPE BEGIN- INTERVAL)) 
((NAME S) (TYPE BEGIN- INTERVAL)) 
(♦EPSILON) (♦INFINITY)) ilSI " JU '" 

(RREL ttlflB « $ TYPE 1W-WTERVAL)) 

<(KAME A) (TYPE BEGIN-INTERVAL) ) 
(0 SECONDS) SECONDS)) 

The separation of the temporal representation from the causal representation 
makes it feasible for THHIPHT to represent the full (infinite) range of possible tem- 
poral configurations between cause and effect instead of restricting these to two 
categories. Moreover, TUP frees the causal reaeoner from the details of managing 
temporal information by automatically performing those temporal inferences that 
derive from any combination of cause-effect temporal relationships. 

Those aspects of expert system reasoning that were found to be purely temporal 
and domain-independent were gathered into a package of utilities— TUP. TUP builds 
its representation on top of two object primitives, the point event and the range 
relation. Intervals, points, qualitative and quantitative temporal relations, position 
with respect to the present, common temporal yardsticks, persistence and alternate 
temporal configurations are all supported by the TUP primitives. The simplicity of 
the underlying representation makes it easy to determine the precision and consis- 
tency of temporal information in the knowledge-base. It also enables TUP to readily 

'These could be added to THRIPHT'i causal links, but in any cm their presence ii not relevant 
to the present discussion. 

4 In the second IBBL, describing the duration of the action A, the seroes in the bounds could be 
replaced by +e depending on the interpretation one wished to impose. 
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retrieve the combination of temporal relations that is most precise in calculating 
the temporal location of an event (with respect to another event). 

TUP's clustering scheme—reference sets— -was arrived at somewhat serendipi- 
tously. Examination of a sample temporal knowledge base revealed that clustering 
that followed the performance criterion* would parallel the clustering of the atem- 
poral portion of the domain knowledge base. In retrospect, the parallel between the 
atemporal and temporal decomposition of the knowledge base is not surprising. As 
explained in chapter 2, both types of clustering are driven by the need to establish 
correspondence between "salience* or "relevance" and the structure of the knowl- 
edge base so as to permit efficient access to the knowledge. THRIPHT illustrates how 
the atemporal decomposition of the domain knowledge— causal aggregation— can be 
used to automatically guide the temporal decomposition. It has since become clear 
that the causal aggregation hierarchy is just one of the knowledge structures that 
are available to guide temporal clustering. As previously discussed, the structure 
of the frame-based systems, plans, the hybrid knowledge representation languages, 
and process descriptions can serve the same purpose. 

In addition to increasing the power of an expert system, temporal reasoning 
considerably loosens the bonds that less expressive expert systems place on the 
knowledge engineer. Temporal knowledge is so ubiquitous that to attempt to fit it 
into an ad hoe representation of temporal sequence is frustrating. Although TUP's 
general-purpose temporal representation eliminates this problem, it creates a new 
obligation for the knowledge engineer— to go out and extract this same ubiquitous 
temporal information. 

6.4 Complications 

TUP's design and implementation addresses many of the issues in automated tem- 
poral reasoning, with some notable exceptions. Of these the one I feel to be the 
most important is the lack of an elegant and general utility for representing recur- 
rent events. In the absence of such a utility, I have had to settle for a very limited 
capability as described in section 2.9.2. Nonetheless, in the same section, I mention 
some promising methods. 

TUP's temporal relation, the range relation u devoid of probabilistic information. 
In many domain applications, systematic temporal probabilistic information is not 

8 i.e. The frequency of retrieval of individual temporal relations. 
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available. This is fortunate because implementing the capability to reason with 
probabilistic temporal information is a formidable task. The goals of generality and 
robustness require, however, that the representation and reasoning mechanisms for 
such a capability be eventually implemented. 

6.5 The Prognosis 

Early in the development of expert systems technology, it was recognised that ex- 
plicit representation of domain-specific knowledge enabled the solution of a large 
class of problems that were intractable using general purpose problem solvers. Prom 
the initial realisation thafln the knowledge lies the power" there has developed a 
corollary axiom (or article of faith): the performance of an expert system is lim- 
ited and brittle to the extent to whkh the knowledge representation compels the 
knowledge engineer to distort the semantics of the domain knowledge. That is, 
a representation language must mirror the semantics of the type of knowledge it 
represents. 

This is not only true of the expert system's performance, but also of its de- 
velopment and debugging. Consequently there has been a broad effort to create a 
nosology of the different types of knowledge that an expert uses and therefore that 
an expert system should explicitly represent. The study of the different types of 
knowledge in an expert system has included: identifying and representing expert 
system strategies [11]; explicitly representing the preferences that lead to the goal 
structure of a decision-maker [63]; explicitly representing the causal aggregation 
hierarchy of hypotheses [50,46], representing the domain principles that justify the 
expert performance [54] and explicitly representing spatial relationships [37]. The 
work that has led to this thesis has been similarly motivated. I have sought to iden- 
tify that part of the knowledge base that involves temporal information and then 
gone on to provide an autonomous utility for reasoning about it in a consistent and 
principled manner. As temporal knowledge is ubiquitous, and particularly so in a 
patient history, the need for such a capability is great. Nevertheless, like the other 
types of reasoning just mentioned, temporal reasoning is necessary but not suffi- 
cient. My goals will therefore have been well satisfied if the the knowledge gained 
here becomes part of the knowledge engineer's armamentarium for the development 
of the next generation of expert systems. 
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• <Pl>, <p3> and <point> are point specifications. 

• <lb>, <ub> are lower and upper bound, respectively. 

• <linit> ii a tingle bound. 

• <f ilter> is any combination of predicates that return, a boolean value. 

• <acope> i. a liet of reference sets. 

• <pelnt Mt> is a list of points. 

• TX and TY are TUP variables. 

• <lntt> and <int2> are interval specification.. 

A.l.l Predicates 

• (BEFORE-P <pl> <pa>) 
b <pl> before <p2>? 

• (AFTER-P <pi> <p2>) 
b <pi> alter <p2>? 

• (BEFOU-BY-P <pl> <pa> <lb> <ub» 

b <pl> before <p2> by the specified amount? 

• (AFTEE-BT-P <pl> <p2> <ib> <ub» 

b <pl> after <p2> by the specified amount? 

• (WIIHIM-P <pl> <p2> <n*it» 

b <pl> within the <linit> distance of <p2>? 

119 
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• (BEF0RE-M0W-P <pl>) 
b <pl> in the put? 

• (AFTER-MOW-P <pl» 
Is <pl> in the future? 

• (BEFORE-HOW-BY-P <pl> <lb> <ub>) 

b <pl> in the past in the specified range? 

• (AFTER-ROW-BY-P <pl> <lb> <ub» 

b <pl> in the future in the specified range? • 

A. 1.2 Assertions 

• (REEL <pl> <p2> <lb> <ub>) 

Assert range relation between <pl> and <p2>. 

• (ASSERT- IMTERVAL <lntl» 

Assert the end points of the interval with bounds of 0,+oo. 

• (IMTREL <intl> <int2> <interral relatlen» 

Assert the two intervab with RRELs between the end points of the intervab corre- 
sponding to the specified interval relation. 

• (RelationToPresent <pl> <lb> <ub>) 
Assert the REEL between <pl> and the present. 

A. 1.3 Point Functions 

• (GETEVEHT <pl> <f ilter» 

Obtain the point consistent with the <pl> specification if filter is true. 

• (FIMDBETWEEX <pl> <p2> <scope>) 

Obtain the points between <pl> and <p2> that are in scope. 

• (FINDPOSITIOI <point> <point set» 

Obtain the ordinal position of point in point set. 

A. 1.4 Relation Retrieval 

• (RREL <pl> <p2> ?X ?T) 

Return the bounds on the RREL between <pl> and <p2> and also bind the returned 
values to the TUP variables. 
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• (INTREL <lntl> <int2> ?X) 

Return a li.* of int«rval relation, which are con«.tent with the REEL, between intl 
and int2. Also bind the returned list to the TUP variable. 

• (EelatlonToPreaent <pl> ?X ?T) 

Return the bound, on the EREL be*™ <pi> „d the current instance of NOW and 
bind the returned value to the TUP variable. Every time thi. query i. evaluated a 
new inetanc. of HOW i. I * wrm t«i „* a. ^i^fe^ to ^ current time, obtained 
from the hott computer retime dock, » •*•*•*. Thi. .ideMtfect i. nece-ary for 
an accurate anewer. 

• (LB-OF <pl> <p2>) 

Rrturn the lower bound on the KIEL between <pl> and <p2>. 

• (UB-OF <pi> <p2» 

Return the upper bound on the IRIL between <pl> and <p2>. 
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A.2 Range Addition 



The table below illustrates the rules of range addition for all the different values for the two 
bounds. l,n and m can be any signed number of seconds. / is distinguished in that it can 
be any number other than sero. 



First bound 




Range Addition 

— e if the two bounds art lower bounds, 
-He if the two bounds aw upper bounds. 
/ 

+€ 
—t 

+€ 

n + m 

+00 

—00 

—00 

+00 

-00 11 the two bounds an tower bounds, 

+00 if the two bounds are upper bounds. 
Table A.l: Range Addition 
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A.3 Interval to Range Relation Conversion 
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Interval Relation 



(INTREL 

{8SS Si! 

BEFORE) 



(INTREL 

iSSS Si! 

AFTER) 



(INTREL 
((NAME A)) 
((NAME B)) 
DURING) 



Equivalent RREU 



<R ^*£i H ^ K /iLi TTPE niD-INTERVAL)) 
((NAME B) (TYPE BEOIN- INTERVAL)) 
(♦EPSILON) (♦INFINITY)) " 



<E ?%.& I ± ME ,±LI TTra BRAIN - INTERVAL)) 
((NAME B) (TYPE END- INTERVAL)) 

(-infinity) (-EFKLON)} 



( %.£i ll ^ E /^i ITP J BMIH-INTERVAL)) 

J ( ?d55.5L{ T T p Li MI *- INTERVAL) ) 

(-INFINITY) (-EPSILON)) 

( *?&»& ,I # B ,±L£ I ZE! pto- INTERVAL)) 
((NAME B) (TYPE END- INTERVAL)) 
(♦EPSILON) (♦INFINITY)) 



Table A.2: Interval Relation To RREL Conversions 
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Interval Relation 



(IMTREL 
((NAME A)) 
((NAME B)> 
CONTAINS) 



(IMTREL 



((MAKE A)) 
((NAME B)) 
OVERLAPS) 



(INTREL 

((NAME B)) 
OVERLAPPED-BT) 



Equivalent RREU 



<R ?%4^ M f ME /iLi T IS E BMII-IMTERVAL)) 



•INFINITY) (-EPSILQM)) 



(RREL ((NAME A) (TTPE BMII- INTERVAL)) 

J ( 2£? Si^F" BWIN^NTERVAU) 
(♦EPSIUW) (♦INFMITT)) 

( *?&*& I f M, Mli TTPS ■"•* INTERVAL)) 
(♦EPSILON) (+INFINITT)) 



(R ?!L& M ± M M> (TTPB BE QIN-i rTERVAL)) 
(-INFINITY) ( -EPSILON)) 

t ^AiS'SF,^LL Tt S lt w»i»-miRVAL)) 

((NAME B) (TTPE SHIN- INTERVAL)) 
(♦EPSILON) (♦INFINITY)) " 
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Interval Relation 



(iran. 

isss ;;? 

STARTS) 



(INTREL 

(883 ft 

STAETED-BY) 



(IHTREL 
((NAME A)) 
((NAME B)) 
FINISHES) 



Equivalent REEL* 



(♦EPSILON) (♦INFINITY)) " 



(R f%.ii ,r H B ,iLi TTp B BEGIN- INTERVAL)) 

(o seconds) (o seconds)) 



<R ?ft 4 ii I ^/ALi T 2S «P-INTERVAL)) 
(-INFINITY) (-EPSIL0I)) 



((NAME B) (TYPE END- INTERVAL)) 
(0 SECONDS) (0 SECONDS)™ 

(B Jftiff i lfMEJ T !" MWW-IWERVAL)) 
((NAME B) (TTR-BMIN- INTERVAL)) 
(-INFINITY) (-EPsSS) " 
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Interval Relation 



(INTREL 
((NAME A» 
((NAME B)) 
FINISHED-BY) 



(INTREL 
((NAME A)) 
((NAME B)) 

EQUAL8) 



(INTREL 
((NAME A)) 
((NAME B)) 
MEETS) 



(INTREL 

iSS ill 

MET-BY) 



Equivalent RRELi 



(REEL ((NAME A) (TTPE END- INTERVAL)) 
(-INFINITT) (-EPSILOS)) 



CHRZL ((HAME^A) (TTPE BE QIN- I NTERVAL)) 
((NAME B) (TTPE BEGIN- INTERVAL)) 
(0 SECONDS) (0 SECONDS)) 

(R1 Sm MAME , B > (TTWt PP-I NTERVAL)) 
((NAME A) (TTPE END-INTERVAL)) 
(0 SECONDS) (0 SECONDS)) 



*^*&HP.ilS r B& «M D-INT ERVAL)) 
$i I £8L ,) J 1 !" 1 BlfllN- INTERVAL)) 
(0 SECONDS) (0 SECONDS) 



(t ^.£P llME .±Li TTPS BEGIN- INTERVAL)) 
((NAME B) (TTPE END-INTERVAL)) 
(0 SECONDS) (0 SECONDS)) 
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A.4 Range Relation to Interval Relation Conver- 
sion 



RREL Assertion 



<B $%.& 1I £ R,!: ,±L< TTPK BMM-I*TERVAL)) 

$ ( S£5, 5L ( T TPK BEflIM - MTERVAL) ) 
(+EPSILOM) (♦IBFIMTTY)) 



(RREL ((MAW A) (TTPE BEQXV-IlfTERVAL)) 
(0 SECOSDS) (0 8EC0BD8)) 



(R ?&»& H £ ME ,±Li TTPE BEOIM-irrKRVAL)) 



(R $fm*± M M > (TTPB BEGI*-IBTEBVAL)) 
((MAKE B) (TYPE EID-IITE1VAL)) 



Consistent 
IXTRELs 



BEFORE OVERLAPS 
MEETS COHTAIHS 
PIII8HED-BT 



STARTS 

8TARTED-BT 

EQUAL 



AFTER 

OVERLAPPED-BT 
MEETS FIIISHES 
DDRIIG 



BEFORE OVERLAPS 



OVERLAPPED-BT 

FIIISHES STARTS 

FIIXSHED-BT 

STARTED-BT 

COBTAIIS 

COMTAIWED-BT 



Table A.3: RREL to Interval Relation Conversions 
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RREL Assertion 



(0 SECONDS) (0 SECONDS)) 



^lii'W&i 111 * BEOIN-INTERVAL)) 
((NAME B) (TTPE END-INTERVALl) 
(-INFINITT) (-EPKUW)™ " 



((NAME B) (TYPE BEGIN- INTERVAL^ 
(♦EPSILON) (♦INFINITY)) " TKEVAL)) 



(RREL ((NAME A) (TTPE END-INTERVALS 
((NAME B) (TTPE BE«"mERVAL» 
(0 SECOMDS) (0 SECONDS)) "*" 



Conaiitent INTRELi 



KJOAL MET-BT 



AFTER 



BEFORE 



EQUAL MEETS 
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RREL Assertion 



<R r&*& ll & B /&i I 2! MD-MTERVAL)) 



(B ?%^ ll i? E ^£Li TTPE hto-mterval)) 

(+EP8IL0*) (+IIPIHTT)) 



(RREL ((VANE A) (TTPE ETO- INTERVAL)) 
(0 SECONDS) (0 SECONDS)) 



5 < fdiSL5iwJ T T PB **»- INTERVAL)) 
(-INFINITY) (-EPSIL0S)) 



Consistent INTRELb 



AFTER OVERLAPS 
OVERLAPPED-BT 
CONTAINS DURING 
NET-BT EQUAL 
FIIISHES 
FINISKED-BY 
STARTS 
STARTED-BT 



BEFORE OVERLAPS 
MEETS DURING 
STARTS 



EQUAL FINISHES 
FINISHED-BT 



CONTAINS 
OVERLAPPED-BT 
AFTER KET-BT 
STARTED-BT 



B. RRELs of the Annotated 
Example 



B.l 



(RREL 



(REEL 



(RREL 



(REEL 



(RREL 



(RREL 



RRELs of a Subhy- (reel 
pothesis of Hepati- 
tis B 



(REEL 



(RREL 



KANE INOCULATION) 
TTPE BEOIN- IHTEBVAL)) 
HAME INOCULATION) 

K (TTPEE«D-IITEEV1L)) 

6 MINUTES) (1 DAT)J 

;ka»b DECR-H EPATI C-FUNCTION) 
TTPE BEGIN- INTERVAL)) 

S£5 55£ R ;KfI!P:f OICTIO,r > 

^J-PP-M TOVAL) ) 
1 MONTHS) (6 MQIIBS)) 



(NAME HBSAG) (EREL 

JJTPJ BEOIH-IHTERVAL)) 
(NAME HBSAG) 
(TTPE END- INTERVAL)) 
1 MONTHS) (7 MONTHS)) 

(NAME ANTI-IBS) (EREL 

(TTPE BEGIN- INTERVAL)) 
(NAME ANTI -HBS) 

(TTP*H?-? ,TBlVi «'» 
♦EPSILON) (♦INFINITY)) 

NAME IMMBHE -EE8P0N 8E) (EREL 

.SB aHSHKBr 

1 MONTHS) (6 MONTHS)) 



NAME RECOVERY) 
TTPlt BEOIN- INTERVAL)) 
«««WOW*T) 
TTPE BID- INTERVAL)) 
♦EPSILON) (+IHFIHITT)) 

[NAME HEPATITIS B) 

32 assure* > 
isunsaEm, 

iNAME JAUNDI CE) 

TTPE BEOIN- INTERVAL)) 

."W JAOEWCE) 

[0 SECONDS) (4 WEEKS)) 

[NAME HB8AG) 
ITTPB END-INTERVAL)) 
NAME ANTI-HBS) 
ITTPE BEGIN- INTERVAL)) 
SECONDS) (3 WEEKS)) 

NAME INOCULATION) 
TTPE BEGIN- INTERVAL)) 
NAME JAUNDICE) 
TTPl BSGM-aTERVAL)) 
60 DATS) (5 MONTHS)) 

NAME DEATH) 
TTPE BEGIN- INTERVAL)) 
NAME HEPA TITIS B) 
TTPE END- INTERVAL)) 

~ (0 SECONDS)) 



__-,-_ INOCULATION) 
TTPE BEGIN- INTERVAL)) 

85 n&suu, 

SECONDS) (0 SECONDS)) 
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(REEL 



(REEL 



(REEL 



(SREL 



(RREL 



(REEL 



(RREL 



(RREL 



(IAMB DEATH) 

■ilBHlBTaaiBn) 

[MANE HMAO) 

[U« ISOeOLATIOR ) 
TTPE BROIH-IMTEEVAL)) 

.RmjCAlIOi 

•IMTEBVAL)) 



i nam*) (2 mama)) 



[TTPE 



[VANE 
TTPE 




;iaw pja-nPATic-roEenao 

;iSi SS2igT vlL)) 

♦EPSILOH) (♦IWIHTT5 

JAW yiRAL- REPH CATIOI) 
TTPE nm-XUBfAL)) 

-lyw^ra-aTERyAL)) 

♦EPSILQI) (1 OATS)) 



TW BWII-IRTIEVAL) 
IAMB ASTX-HM) 
.TTPE BEMR-HTERTAL 
♦EPSttQS) (♦lEFIJI 



(RREL 

((RAME HEPATI TI8-B ) 
(TTPE BEOnr-HTERVAL)) 

(60 DATS) 3" 



PATITIS) 




HEPATITIS) 
HEPATITIS) 




fRpROg/ACTTE-HEPATITIS) 
ETO-IITKRVAL)) 

UTERVAL)) 
♦EPSILOM)) 
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B.2 Notes on the RRELs 

1. HBSAG and AKTI-HBS refer to detectable levels of the hepatitis B surface anti- 
gen and antibody respectively. 

2. IMMUKE-RESPOKSB is an aggregate of the causally-connected set of event, that 
are part of the immune system's response to the viral infection. For the 
purpose of demonstration, I have not represented any of these component 
events except for the AKTI-HBS in either the KRELs or in the atemporal causal 
hypothesis. 

B.3 Temporal Assertions from the Patient His- 
tory 

(RelationToPreseat ((MAKE IHOOTLATIOE) 

(0 WEEKS) (13 WEEKS)) 

(RREL ( £5££ IWCULATHW) 

(TYPE BEOIE-IMTERVAL)) 

(8 WEEKS) (0 WEEKS)) 

(REEL ((EEFSY8F0RN "45 TEARS OLD") 
(REFSTS AGE) 
JTTPE POIKT)) 

( SJTSEBiiSi 01 kH - n* 18T - 1M6,,) 

(ttpe pout)) 

(0 SECOSSS) (0 fECOSSS)) 
(REEL ((KANE JAUIDICE) 

( E^fT^B^ iM - J0SE28IH - 1M8 "> 
(0 SKCoSi) (0 SSC8SB8)) 

B.4 Notes on the Assertions of the Patient His- 
tory 

1. In the disease hypothesis for hepatitis B, the parenteral introduction of the 
infectious agent is represented as IKOCULATIOE rather than a blood transfu- 
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sion. Although this synonym matching could b« done automatically, in the 
current implementation I have to provide the substitution. 

2. Observe, in Figure 3.2, that the CAXEMDaR mini-expert calculates the tem- 
poral distance between the three date points. TUP's constraint propagation 
algorithm does the rest. 



C* Abbreviations 



Abbreviation 



RREL 



REFSET 



REFSYS 



SCH 



TUP 



THRIPHT 



Definition 



The Range Relation is the TUP primitive for representing the 
temporal dietance between two point*. 



The Reference Set restrict* constraint propagation to those 
points that share set membership. 



Reference Systems are commonly used temporal "yardsticks" 
such as the calendar, age, or stages in human development. 



The Salience Clustering Heuristic exploit, the correspondence 
between the salience of information and its accessibility in 
knowledge structures and the parallel between atemporal and 
temporal salience to guide the automatic generation of refer- 
ence sets. 



The Temporal Utility Package supports assertions and queries 
to a data base of temporal information. 



Temporal Hypothesis Reasoning In Patient History Taking: a 
diagnostic medical expert system prototype built to demon- 
strate the use of TUP. 

Table C.l: Abbreviations 
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